INFM 203-10 (2-Units)
Big Data Analytics and Management
Fall 2020 Syllabus
Dr. Glen R.J. Mules
Email
Office: Home/Office in New Rochelle, NY -- available online
Phone: +914.235.7916
Office Hours: Virtually, by appointment (use e-mail to schedule). Zoom optional drop-in office hours will also be held as needed. Eastern timezone.
Syllabus Links Textbooks CLOs Program Learning Outcomes (PLOs) Prerequisites |
Resources Canvas Login and Tutorials iSchool eBookstore Other Readings |
Canvas Information: This two-unit course runs from October 12 to December 7, 2020. The class will be available on Canvas on October 11. Grades will not be posted at the end of the semester.
You will be enrolled in the Canvas site automatically.
Course Description
Covers important big data technologies, trends, infrastructure, and management issues that enable users to make informed and strategic decisions with the presence of large-scale data sets.
Course Requirements
This two-unit course is an offering of SJSU’s School of Information, which offers all courses completely online. Home computing requirements are posted online for prospective students at Home Computing Environment - http://ischool.sjsu.edu/current-students/technology-support/home-computing-environment. Students must meet those minimum requirements to participate in the activities for this course.
This schedule and related dates/readings/assignments is tentative and subject to change with fair notice. Any changes will be announced in due time in class and on the course’s web site in the Canvas Learning Management System. The students are obliged to consult the most updated and detailed version of the reading material and syllabus, which will be posted on the course’s website.
Course Calendar
Week# -- Starting Date |
CLOs |
Topics |
1 Mon 12-Oct-20 |
1. What is Big Data? What is Data Analytics? 2. Roles: Business Analyst, Data Engineer, Data Scientist Project Initialization |
|
2 Mon 19-Oct-20 |
3. Hadoop & HDFS 4. MapReduce and Distributed Computing |
|
3 Mon 26-Oct-20 |
5. Spark 6. The Hadoop Ecosystem |
|
4 Mon 02-Nov-20 |
7. Data Lakes / Data Fabric / Cloud 8. Relational Databases & the NoSQL movement |
|
5 Mon 09-Nov-20 |
9. Data Movement Multiple Choice Quiz (MCQ) |
|
6 Mon 16-Nov-20 |
10. Programming for Big Data 11. Using Data Notebooks for Data Science 12. Data Visualization |
|
7 Mon 23-Nov-20 |
13. Management, Governance, and Data Security Research Paper |
|
8 Mon 30-Nov-20 |
Course Review Final Exam (MCQ + Short Answer) |
|
Mon 07-Nov-20 |
|
End of Class |
Grading
Grading will be based on a total accumulation of a possible 100 percent, distributed as follows:
Deliverables |
Percent of overall grading (Total = 100%) |
Hands-on Practices (“Labs”) |
40% |
Semester Mini-Project |
Milestone I: 2% Final Report & Project Demo (including comments on other student Projects): 25% |
Research Paper |
5% |
Mid-Semester Quiz/Exam & Final Exam |
25% |
The deliverables will be graded using larger point values but the totals for each type of deliverable will be scaled to the relative percentages shown.
Hands-on Practices (40% of overall grade, supports CLO 2).
Individual, hands-on practices will be given throughout the semester to help students review and reinforce what they have learned in class. Students will learn how to analyze and visualize big data with practical tools.
These Labs (or Hands-on Practices) are an important part of the course. The Labs generally require the submission of a Lab Report (MS Word File, .docx) to the Canvas website for the course.
Semester Project (30% of overall grade, supports CLOS 1-4).
Students will work in teams or alone on a project that consists of three phases (more details TBA on the Canvas site). The main requirement of the project is that it uses at least one of the tools covered in the class
- Milestone I - Initial Thoughts: Students will submit a short paragraph discussing the potential topics and directions of the semester project. Students will also briefly present the motivation of the study and the approach that might be taken.
Emphasis in the Project is on understanding the chosen data-set, data gathering, data munging / preparation, and the steps leading towards data analysis (this work is generally 60-80% of any data project).. Heavy analysis and computer programming are beyond the scope of the project.
- Milestone II - Mini Report: Students will submit a one-page report outlining the current progress of the project. The report will include what has been done, what the current status and results are, and what needs to be accomplished.
- Final Report and Demo: Students will submit a detailed, 10-page report for the project. The report should at least include the following sections: motivation, problem statement, methodology, analysis results, discussion, and conclusions. Students will also prepare a short "demo" to present and discuss their work.
Research Paper (5% of overall grade, supports CLO 4): The Research Paper will deal with topics such as Ethics related to Big Data Acquisition and Usage.
Mid-Semester Quiz (Multiple Choice Questions [MCQ] + Short-Answer Questions) + Final Exam Online (Multiple Choice Questions [MCQ] + Short-Answer Questions) & Final Practical Exam (25% of overall grade, supports CLOs 1-4)
Course Calendar including Assignment Due Dates:
All assignments are due by Midnight Pacific Time on the Sunday Night at the end of the relevant week unless noted differently below.
Week# -- Starting Date |
Practical-Labs & Semester-Project Assignments |
1 Mon 12-Oct-20 |
Lab #1: Download and install Virtual Machine (VM) for Hadoop Labs. Project: Semester Mini- Project Initialization |
2 Mon 19-Oct-20 |
Lab #2: Explore HDFS and run a simple Hadoop job Project: Choose Dataset that you will use |
3 Mon 26-Oct-20 |
Lab #3: Additional exploratory work with Hadoop VM Project Milestone 1: Initial Thoughts (discuss direction of project) |
4 Mon 02-Nov-20 |
Lab #4: TBD |
5 Mon 09-Nov-20 |
Lab #5: Data Movement Project Milestone 2: One-page report on current progress of the project Multiple Choice Mid-Semester Quiz/Exam (MCQ + Short Answers) |
6 Mon 16-Novr-20 |
Lab #6: Using Jupyter Notebooks for running Python, etc. and for Data Visualization |
7 Mon 23-Nov-20 |
Research Paper on Management, Governance, Data Security, and especially the Ethics of Working with Data -- due date is by end of this week. |
8 Mon 30-Nov-20 |
Project Presentations / Submissions: Submit the final version of your Mini-Project -- due date is Wednesday 02-Dec-20. In addition. you must comment on the work of at least two projects by the end of the week (Sunday) Final Written Exam – Online on Canvas (both MCQ + Short Answer) |
Mon 07-Dec-20 |
Last Day of Instruction |
Additional Readings
Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., & Byers, A. H. (2011). Big data: The next frontier for innovation, competition, and productivity. Retrieved from href="https://www.mckinsey.com/~/media/mckinsey/dotcom/insights%20and%20pubs/mgi/research/technology%20and%20innovation/big%20data/mgi_big_data_full_report.ashx
Various Apache Software Foundation (ASF) websites:
Overview: https://hadoop.apache.org/docs/current
MapReduce tutorial: https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html
WordCount 2: https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html#Example:_WordCount_v2.0
Spark: https://spark.apache.org
Flume: https://flume.apache.org
Sqoop: https://sqoop.apache.org
Google's Paper on Big Table: https://research.google.com/archive/bigtable.html
Google's Paper on MapReduce: https://research.google.com/archive/mapreduce.html
FTC Report on Big Data: Tool for Inclusion and Exclusion: https://goo.gl/YgPCWv
Hadoop Governance White Paper: https://info.hortonworks.com/rs/549-QAL-086/images/Hadoop-Governance-White-Paper.pdf
Articles on specific topics:
Spark: https://databricks.com/spark & https://ibm.com/spark
Other electronic articles referenced during the course itself.
Course Workload Expectations
Success in this course is based on the expectation that students will spend, for each unit of credit, a minimum of forty-five hours over the length of the course (normally 3 hours per unit per week with 1 of the hours used for lecture) for instruction or preparation/studying or course related activities including but not limited to internships, labs, clinical practica. Other course structures will have equivalent workload expectations as described in the syllabus.
Instructional time may include but is not limited to:
Working on posted modules or lessons prepared by the instructor; discussion forum interactions with the instructor and/or other students; making presentations and getting feedback from the instructor; attending office hours or other synchronous sessions with the instructor.
Student time outside of class:
In any seven-day period, a student is expected to be academically engaged through submitting an academic assignment; taking an exam or an interactive tutorial, or computer-assisted instruction; building websites, blogs, databases, social media presentations; attending a study group;contributing to an academic online discussion; writing papers; reading articles; conducting research; engaging in small group work.
Course Prerequisites
Graduate Standing or Instructor Consent.
Course Learning Outcomes
Upon successful completion of the course, students will be able to:
- Describe and explain how the main technologies and trends in big data work, specifically data visualization, large-scale database management, map-reduce paradigm, and big data mining.
- Demonstrate proficiency in using current big data technologies to solve big data analytical problems.
- Interpret and communicate big data analysis and visualization results appropriately, effectively and accurately.
- Discuss, articulate and compare various big data management issues (e.g., big data privacy).
SLOs and PLOs
This course supports Informatics SLO 3: Demonstrate proficiency in using current big data and electronic records technologies to solve analytical problems; including developing policies, standards, and practices in particular specialized contexts and interpreting and communicating analysis and visualization results appropriately and accurately.
SLO 3 supports the following Informatics Program Learning Outcomes (PLOs):
- PLO 2 Evaluate, manage, and develop electronic records programs and applications in a specific organizational setting.
- PLO 3 Demonstrate strong understanding of security and ethics issues related to informatics, user interface, and inter-professional application of informatics in specific fields by designing and implementing appropriate information assurance and ethics and privacy solutions.
- PLO 6 Conduct informatics analysis and visualization applied to different real-world fields, such as health science and sports.
Textbooks
Required Textbooks:
- Döbler, M., & Großmann, T. (2019). Data visualization with Python. Packt Publishing. Available through Publisher
- Godsey, B. (2017). Think like a data scientist: Tackle the data science process step-by-step. Manning. Available through Amazon: 1633430278
- Kaldero, N. (2018). Data science for executives: Leveraging machine intelligence to drive business ROI. Lioncrest Publishing. Available through Amazon: 1544511256
- McCreary, D., & Kelly, A. (2013). Making sense of NoSQL: A guide for managers and the rest of us. Manning Publications. Available through Amazon: 1617291072
Recommended Textbooks:
- Spivey, B., & Echeverria, J. (2015). Hadoop security: Protecting your big data platform. O'Reilly Media. Available through Amazon: 1491900989
- White, T. (2015). Hadoop: The definitive guide (4th ed.). O'Reilly Media. Available as free download http://grut-computing.com/HadoopBook.pdf
- Zikopoulos, P. C., Eaton, C., deRoos, D., Deutsch, T., & Lapis, G. (2012). Understanding big data: Analytics for enterprise class Hadoop and streaming data. McGraw Hill. Available for free download at: The iSchool
- Zikopoulos, P., deRoos, D., Bienko, C., Buglio, R., & Andrews, M. (2015). Big data beyond the hype: A guide to conversations for today's data center. McGraw Hill Education. Available for free download at: The iSchool
Grading Scale
The standard SJSU School of Information Grading Scale is utilized for all iSchool courses:
97 to 100 | A |
94 to 96 | A minus |
91 to 93 | B plus |
88 to 90 | B |
85 to 87 | B minus |
82 to 84 | C plus |
79 to 81 | C |
76 to 78 | C minus |
73 to 75 | D plus |
70 to 72 | D |
67 to 69 | D minus |
Below 67 | F |
In order to provide consistent guidelines for assessment for graduate level work in the School, these terms are applied to letter grades:
- C represents Adequate work; a grade of "C" counts for credit for the course;
- B represents Good work; a grade of "B" clearly meets the standards for graduate level work or undergraduate (for BS-ISDA);
For core courses in the MLIS program (not MARA, Informatics, BS-ISDA) — INFO 200, INFO 202, INFO 204 — the iSchool requires that students earn a B in the course. If the grade is less than B (B- or lower) after the first attempt you will be placed on administrative probation. You must repeat the class if you wish to stay in the program. If - on the second attempt - you do not pass the class with a grade of B or better (not B- but B) you will be disqualified. - A represents Exceptional work; a grade of "A" will be assigned for outstanding work only.
Graduate Students are advised that it is their responsibility to maintain a 3.0 Grade Point Average (GPA). Undergraduates must maintain a 2.0 Grade Point Average (GPA).
University Policies
Per University Policy S16-9, university-wide policy information relevant to all courses, such as academic integrity, accommodations, etc. will be available on Office of Graduate and Undergraduate Programs' Syllabus Information web page at: https://www.sjsu.edu/curriculum/courses/syllabus-info.php. Make sure to visit this page, review and be familiar with these university policies and resources.
In order to request an accommodation in a class please contact the Accessible Education Center and register via the MyAEC portal.
Download Adobe Acrobat Reader to access PDF files.
More accessibility resources.