Microsoft Power BI Updates around 9/20/2021
I’m definitely suffering from low motivation – I just want to sit and look at videos or TV. Feeling meh even though I know I have stuff to do. Thankfully, I did do some stuff yesterday. Tonight, I thought I would do a post to try to make up for the meh feeling.
A couple of days ago, Microsoft did an update to Power BI but it was not a typical update. Instead, it came out with a message saying that my file was “encrypted” and that I needed to click on the link to learn more (either that or download a new version of Power BI…I don’t remember anymore). Usually Microsoft just updates without warning me or giving me a choice to opt out.
And during that update, I had to re-do all of my automatic links to the websites or whatever connection/source I was using. That was very different. I don’t know why it was so different unless there was some kind of security issue and the company needed to be sure that an actual person as opposed to a bot updating the software.
It was very odd and it threw me off.
Today, when I went back in to do my usual Power BI refresh, the graphs ended up looking different.
The charts above came from the healthdata.gov or the HHS site. The data are typically one or two weeks behind and gets updated weekly.
An extra few weeks of data seems to have been added on the front end which makes the rest of the chart very distorted and appear way different from what was being displayed before the Microsoft update. I don’t think the Microsoft update caused this change; I think it was the HHS site itself that added additional weeks of data.
Sources of Data
WORLD : Cases and deaths from Wikipedia website https://en.wikipedia.org/wiki/COVID-19_pandemic_by_country_and_territory
US and STATES : Five main sources of data are available – Wikipedia, COVID Tracking Project, CDC, JHU, and HHS
Wikipedia: Wikipedia has broken out their tables into four links, separating out the cases from deaths and separating out the years.
New Cases 2021: https://en.wikipedia.org/wiki/Template:2019–20_coronavirus_pandemic_data/United_States_medical_cases
New Cases 2020: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_cases_in_2020
New Deaths 2021: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_deaths
New Deaths 2020: https://en.wikipedia.org/wiki/Template:COVID-19_pandemic_data/United_States_daily_deaths_in_2020
COVID Tracking Project: The COVID Tracking Project was a collaborative effort of free labor overseen by The Atlantic. This project ended on 3/7/2021. The Atlantic’s COVID Tracking Project was provided under Common Creative license “CC BY-NC-4.0” and covered cases, deaths, hospitalization, and positivity, amongst other data.
API: https://covidtracking.com/api/v1/states/daily.csv
Table: daily
CDC: CDC has become a replacement for the COVID Tracking Project for me although the data will often come in a few days later. Hospitalization comes in a week later. I’m tracking cases, deaths, hospitalization, and positivity.
Centers for Disease Control and Prevention, COVID-19 Response. COVID-19 Case Surveillance Public Data Access, Summary, and Limitations
Table: rows
API:
Cases and deaths: https://data.cdc.gov/api/views/9mfq-cb36/rows.csv
Hospitalization: https://beta.healthdata.gov/api/views/g62h-syeh/rows.csv (Good data doesn’t start until about 7/15/2020)
Testing: https://beta.healthdata.gov/api/views/j8mb-icvb/rows.csv
Positivity: https://beta.healthdata.gov/api/views/j8mb-icvb/rows.csv
John Hopkins University (JHU): I rarely show these sets of data; I mostly use Wikipedia or CDC but sometimes I like to reference the JHU.
Please cite our Lancet Article for any use of this data in a publication (link)
Provided by Johns Hopkins University
Center for Systems Science and Engineering (JHU CSSE):
https://systems.jhu.edu/
Terms of Use:
1. This data set is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) by the Johns Hopkins University on behalf of its Center for Systems Science in Engineering. Copyright Johns Hopkins University 2020.
2. Attribute the data as the “COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University” or “JHU CSSE COVID-19 Data” for short, and the
url: https://github.com/CSSEGISandData/COVID-19.
3. For publications that use the data, please cite the following publication: “Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Inf Dis. 20(5):533-534. doi: 10.1016/S1473-3099(20)30120-1”
Website https://github.com/CSSEGISandData/COVID-19
HHS: Hospitalization data for US – can be US level, state level or county level