Data Changed
My state changed the way they lay out the data: some file names changed, some tab names changed, layout changed and some of the data itself changed. I had to spend time reviewing the changes and mapping the files to the old files to determine what I needed to do when changing my programs. I got the main pieces done and what’s left is the minor stuff that I can adjust over time.
This change meant that a lot of tasks that I normally do got pushed back, so I feel like I am not getting things done. It’s been hard to get anything done because I’ve focused attention on these aforementioned changes. The re-programming is mostly done, except for the minor stuff, so now it is time to catch up.
The massive changes in the data are worrisome. The general shape of the charts appears to be the same, but the absolute numbers are very different. I’m not sure what that means. At first, I thought it was me not paying attention, but no, I actually have something that checks the numbers to see if something changed. Also, other sites that I pull from also show this single day jump in the numbers, so I know that the state is doing some kind of reconciliations and updates. The updates extend way back into early part of 2021, suggesting to me that the updates are not related to a “holiday” correction.
The changes came out on a Friday, before the MLK weekend, so if I were conspiracy minded, I would say it feels like the state government is trying to hide this change. There is no note on the site to explain what is driving the jump in the data.
Little Quick Review on Corona
[The source of data for all of these charts came from Wikipedia. See “Sources of Data” at the end of this post.]
Before I end this post, I want to show a graphic of the coronavirus data for the world as a whole to show the omicron variant is really driving a surge worldwide. The chart on the left show cases driving upward with a fairly sharp upward curve whereas the deaths on the right is plodding upward at a steady pace:
Top 10 Countries
Here’s the top 10 countries by cases accumulated over the last 14 days. You can see that some countries appear to be experiencing a sharp decline in cases, kind of like an “ice pick” signature. Those with the “ice pick” signature includes the US, France, and UK. The ones NOT declining yet appears to be India and Brazil.
Continents
Here’s the continents: the surge appears to have halted in the US and Europe.
Regions
Finally, here is a chart showing the trends in each of the regions of the US. The surge in the Northeast appears to have crested and may be the single biggest reason why the US as a whole appears to have halted its surge. However, this halt may not last long because the other regions may come into play. I want to stress the word may because the surge may be rolling across the US and thus, if enough states undergo a surge at the same time, then the overall US could rise again.
I’m going to stop here rather than go on to the charts showing the individual states. I’ve done enough to touch on the general trends at this point in time.
Sources of Data
WORLD : Cases and deaths from Wikipedia website https://en.wikipedia.org/wiki/COVID-19_pandemic_by_country_and_territory
US and STATES : Five main sources of data are available – Wikipedia, COVID Tracking Project, CDC, JHU, and HHS
Wikipedia: Wikipedia has broken out their tables into four links, separating out the cases from deaths and separating out the years.
New Cases 2021: https://en.wikipedia.org/wiki/Template:2019–20_coronavirus_pandemic_data/United_States_medical_cases
New Cases 2020: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_cases_in_2020
New Deaths 2021: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_deaths
New Deaths 2020: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_deaths_in_2020
COVID Tracking Project: The COVID Tracking Project was a collaborative effort of free labor overseen by The Atlantic. This project ended on 3/7/2021. The Atlantic’s COVID Tracking Project was provided under Common Creative license “CC BY-NC-4.0” and covered cases, deaths, hospitalization, and positivity, amongst other data.
API: https://covidtracking.com/api/v1/states/daily.csv
Table: daily
CDC: CDC has become a replacement for the COVID Tracking Project for me although the data will often come in a few days later. Hospitalization comes in a week later. I’m tracking cases, deaths, hospitalization, and positivity.
Centers for Disease Control and Prevention, COVID-19 Response. COVID-19 Case Surveillance Public Data Access, Summary, and Limitations
Table: rows
API:
Cases and deaths: https://data.cdc.gov/api/views/9mfq-cb36/rows.csv
Hospitalization: https://beta.healthdata.gov/api/views/g62h-syeh/rows.csv (Good data doesn’t start until about 7/15/2020)
Testing: https://beta.healthdata.gov/api/views/j8mb-icvb/rows.csv
Positivity: https://beta.healthdata.gov/api/views/j8mb-icvb/rows.csv
John Hopkins University (JHU): I rarely show these sets of data; I mostly use Wikipedia or CDC but sometimes I like to reference the JHU.
Please cite our Lancet Article for any use of this data in a publication (link)
Provided by Johns Hopkins University
Center for Systems Science and Engineering (JHU CSSE):
https://systems.jhu.edu/
Terms of Use:
1. This data set is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) by the Johns Hopkins University on behalf of its Center for Systems Science in Engineering. Copyright Johns Hopkins University 2020.
2. Attribute the data as the “COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University” or “JHU CSSE COVID-19 Data” for short, and the
url: https://github.com/CSSEGISandData/COVID-19.
3. For publications that use the data, please cite the following publication: “Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Inf Dis. 20(5):533-534. doi: 10.1016/S1473-3099(20)30120-1”
Website https://github.com/CSSEGISandData/COVID-19
HHS: Hospitalization data for US – can be US level, state level or county level
You must be logged in to post a comment.