Submit the following programs via the honors section of Gradescope:
- HC 1: Team Contract and Dataset (Airbnb or another dataset of your choice) Due Date: 1 September
Throughout the semester, we will analyze the Airbnb dataset of New York listings from 2019.
Step 1 -- Project structure:
We will work in teams. Each team will choose a borough to analyze. Each team member will then choose a neighborhood in that borough to report on.
Throughout the semester each team will provide different analyses of the overall borough supplemented by analyses of the chosen neighborhoods.
These analyses will be broken down across different assignments and will be a mix of research and data analysis.We propose to use the Airbnb dataset of New York listings from 2019. However, we give you the freedom to choose a different dataset if that would inspire you more. Another great place to look for data is NYC Open Data. If you choose a different dataset, it must have the following properties to guarantee that you will be able to fulfill all the assignments despite working with different data:
- The data must have an attribute (column) corresponding to neighborhoods (preferably NYC)
- It must include some numerical data
- It must include some categorical data
- It must include geographical locations (latitude and longitude columns, or exact address column)
Discuss with your assigned team to decide on a dataset, then move on to Step 2.
Note: You don't need to identify the alternate dataset in this assignment, but if you are considering it you should indicate so in Step 2 and must identify the dataset no later than our next meeting on September 4.Step 2 -- Team Contract:
Work with your assigned team to complete the Team Contract.
Once your contract is complete and signed by all team members, upload a .pdf to the assignment HC 1. in the honors section of Gradescope. This will be a group submission (one submission per team). Unlike the Python code, it is not automatically graded.
- HC 2: Neighborhood Analysis
Due Date: 8 September
To begin, discuss with your team to pick a neighborhood in your team's borough (a different neighborhood for each team member). Keep in mind that you want all the neighborhoods together to be representative of the borough. You also want to be sure your neighborhood is well represented in the dataset.
Create a single page summary of your neighborhood that includes at least the following:
- Name of the neighborhood (include in the title),
- The zip code(s) of your neighborhood,
- A map of New York City with your neighborhood highlighted,
- A photo or image that captures your neighborhood and
- The demographics of your neighborhood.
A great resource for your analysis is Social Explorer. Note: you don't need to necessarily create an account. From the top menu, select Resources - Demographic Profiles and enter the zip code(s) of your neighborhood to find a wealth of information.Submit a .pdf file containing your summary.
- HC 3: Neighborhood Rankings
Due Date: 15 September
Design a ranking for the most desirable features of a neighborhood.
There are multiple rankings of New York City Neighborhoods. For example,
- Niche,
- DNA Info's rankings,
- Brick Underground,
- Curbed's Walkable Neighborhoods,
- BuzzFeed,
- Street Advisor
- Assess what these rankings have in common and how they differ.
- Which ranking do you favor and why?
- What qualities make a neighborhood a desirable place book a room or apartment in?
- Collate a list of the three most important.
- How does each neighborhood in your team's borough fare according to this ranking?
Submit a .pdf file containing your assessment of the rankings and the three most desirable qualities, as well as a ranking of your team's borough (if all neighborhoods fare the same, you may indicate so and group the discussion to the borough). You should use complete sentences, compare and contrast the rankings above and justify the three qualities that your group thought most important. This will be a group submission (one submission per team).
- HC 4: Synchronous Discussion
Due Date: 25 September IN LAB
In this meeting we will discuss your findings from HC 2 and HC 3. Before the meeting, your team should select a speaker from the designated speakers in section A.- c. on your Team contract. This team member will be responsible for summarizing the overall discussion of the borough from that of the neighborhoods to the entire group. The speaker may also call on another team member if a neighborhood-specific aspect is particularly relevant to the discussion.
No submission necessary. This assignment will be graded based on your group's contribution to the discussion.
Grading criteria:- Speaker presents one particular finding from HC2, explains why it was chosen and indicates if individual neighborhood analyses aligned or differed on this particular finding.
- Speaker presents the 3 neighborhood qualities chosen for HC3, explains why these were chosen and indicates if individual neighborhoods aligned or differed for this ranking.
- Speaker provides satisfactory summary in 5 minutes or less.
- HC 5: COVID impact on Airbnb
Due Date: 6 October
In lab we will break into groups for 15 minutes to briefly consider/research the topic (browse the web to get an idea of possible topics), then we will reconvene to discuss.
Discussion should focus on:
- Mention at least one source you found intriguing and wish to explore further and tell us why.
- Tell us if there is a relationship between your HC2 and HC3 analysis (the qualities of your neighborhood) and your source/story (there doesn't have to be one).
- Airbnb (the company) vs Hosts
- Hosts vs Guests
- Airbnb vs Hotels
Submission: Choose a source and submit a summary in pdf. Extra credit will be awarded if you can make a connection between the story and your neighborhood (your analysis in HC2 and HC3). This can be a group or individual submission. If you wish to work together as a group you can all submit the same summary. If you do, please indicate so at the top of the document.
- HC 6: Highlighted Map
Due Date: 13 October
For this program, we will create a highlighted map centered around your neighborhood, with the region within about a 1/4 mile box around a marker at the center of the neighborhood at full brightness, the region outside that box at 50% brightness.
To do this:
- Create a .png file of a satellite map, centered on your neighborhood (Google maps works well for this, but you can use any mapping site to create your base map).
- Write a Python program that reads in an image and saves the image to another file. Run your program to make sure the reading and saving of an image works.
- Set the upper region of the image to 50% brightness (hint: uses slices and see example in Lecture 3 and 4). Run your program to make sure it has dimmed up the upper region and adjust to get the correct dimenssions.
- Set the lower region of the image to 50% brightness (hint: think about what negative numbers mean as indices). Run your program and fix any bugs.
- Next, dim the side regions (hint: think about what parts of the image have not been dimmed and change only those regions.)
Submit your answer as a .pdf file (both code and image) to Gradescope.
- HC7 & HC8 Progress Report
Due Date: 30 October: IN LAB
Each group has 5 minutes to report on what they did so far and what they plan to do to wrap up the assignment for next week.
- HC7 & HC8: Data Analysis
Due Date: 3 November
For this assignment, we will analyze our dataset. This assignment will span over the course of two weeks (two meetings).
During the first meeting, on 16 October, look over this data-analysis document, it will illustrate how to explore, clean and visualize the data.
Read this document together, discuss it and make sure you understand it. Then make a plan together about what you will look for in the data and how.During the following meeting, on 23 October, you should come with a working-in-progress program (this is not a typo, the program should be complete and working even if not final) and you will work as a team to refine your analysis (your program) and produce the group analysis for the borough.
Although these will be due the same day, I will separate HC7 and HC8 into two different submissions:
- HC7: individual submission analysis of your neighborhood
- HC8: group submission analysis the borough
These two analyses may mirror each other and the grading criteria for these assignments will be the same and as follows:
Grading Criteria:
- Analyzes the data to provide statistics for the neighborhood/borough and discusses these observations in writing (something like what you saw in the data-analysis document) but you can simply report and discuss the stats, don't need to include the code. If you observe anything that seems anomalous don't hesitate to report so, data is never perfect! (meets: 2, exceeds:3)
- Makes observations that go further what may be simply observed by using the describe() function. (meets:2, exceeds: 3)
- Provides and discusses visualization for the data observed (at least 3 plots, more is better). These can be any type of plot, use what makes sense for your observations. Play and have fun with the data!!! Include the images and don't forget to discuss them!!! (meets:2, exceeds: 4)
- Extra Credit: Makes a connection between data analysis and observations made in HC2/HC3, in a paragraph and visually supported with plot(s). (5 points)
What to submit:
- A report of your analysis including statistics and images supported by a discussion. Submit as a .pdf file.
- A copy of your program as a .pdf file.
- HC 9: Neighborhood Map
Due Date: 10 November
Using folium, generate an html map with markers for the airbnb listings in your neighborhood.
To do so:
- Create a neighborhood dataframe by selecting only the rows for your neighborhood
- Create a map object
- Loop for each row in the neighborhood dataframe to
- create a marker for that latitude and longitude
- add the marker to the map
- Save the map to an html file
Hint: You can mirror the program in Lab9 that creates a map with markers for CUNY campuses.
Note: If your neighborhood has too many listings and the map is excessively crowded, you can select a random subset. Don't remove too many, however, so that the map remains representative of the data.
Submit a screenshot of your map and your code as a .pdf file.
- HC 10: Webpage Due Date: 17 November
We are going to use github to make webpages for your projects. There will be only one site for each project, but we want everyone to set up their own neighborhood page the project webpage will link to.
Create a github page for your neighborhood.
- If you haven't done so already, set up a repository for your neighborhood project (see the getting started tutorials from Lab 6 on how to set up a repository).
- Follow through the options for setting up a page for your project (right under the "Ready to get started?" choose 'Project site').
- Include on your neighborhood page:
- the name of the neighborhood,
- the highlighted map from HC6 as an image
- the basic demographics & statistics from HC 2
- one paragraph summarizing your observations from HC3
- a summary of your results from HC7 and HC8 along with plot images, and
- the map from HC9 (embedded as iframe -- see below)
To embed an html as an iframe use the following html tag (assuming your map is called manhattan.html and it lives in the same directory as the page you want to embed it into)
<iframe src="manhattan.html" width="600" height="400" frameborder="0" frameborder="0" marginwidth="0" marginheight="0" allowfullscreen></iframe>
If you are using markdown, you can insert html code by surrounding it with dl tags as in:<dl> <iframe src="manhattan.html" width="600" height="400" frameborder="0" frameborder="0" marginwidth="0" marginheight="0" allowfullscreen></iframe> </dl>Submit a .pdf file that contains the URL of your project on github (web address) and a screenshot of your project.
Useful links:
- Markdown Cheatsheet
- If you prefer to watch a video tutorial instead of following the github tutorial page linked above, there are plenty, non-official, youtube videos on how to set up your first Gihub webpage... choose the one you prefer to listen to.
- HC 11: Draft Presentation and Project Webpage Due Date: 24 November
Generate a project webpage with a small introduction that includes the information in your slides, a brief summary of your borough overview (from HC2, HC3, HC8) and links to all neighborhood webpages.
Submit the slides of your group presentation (two slides) as a .pdf file. Your slides should include who is on the team, the neighborhoods you looked at, a brief description/summary of the project and a link to the project webpage (your presentation must be 3-5 minutes).
- HC 12: Feedback Forms Due Date: 1 December
During our meeting each team will share their project webpage and the rest of the class will provide constructive feedback for improvement.
As per your Team Contract signed at the beginning of the semester, you will evaluate each member of your team by filling out and submitting this form. After you fill it out, submit the form as pdf.
- HC 13: Final Project Presentation Due Date: 4 December -- IN LAB
Each team will present their project (5 minutes each, 2 slides), then we will break into groups and our visitors will join different groups where you will do a poster-like presentation using the project webpage to talk more about your project and individual contributions.