Today, we added more PubMed and NCBI stuff from NIH:
Today, we added more PubMed and NCBI stuff from NIH:
Today I noticed a heck of a lot of 404's when I was fetching #pubmed data. Seems there was a thorough gutting there this week. Links to articles are still there but the articles themselves are going missing en masse. I'm going to continue to grab and post what I can here:
Today saw more incremental updates to NVD and NIH data. More on the way soon!
https://git.lsit.ucsb.edu/publicdata/nih-gov
https://git.lsit.ucsb.edu/publicdata/nist-gov
Just published a sizable update to NIH archives, including among other things a bunch of pubmed article and book data.
https://git.lsit.ucsb.edu/publicdata/nih-gov
More coming soon!
Today we published a sizable update to the Social Security Administration public archive. (Please note that the layout of the repo has changed to accommodate other subdomains of the SSA.)
https://git.lsit.ucsb.edu/publicdata/ssa-gov
More on the way soon!
Today, we published initial archives of US International Development Finance Corporation (DFC) and Delta Regional Authority (DRA), and updated the NIST NVD and cancer.gov archives.
https://git.lsit.ucsb.edu/publicdata/dfc-gov
https://git.lsit.ucsb.edu/publicdata/dra-gov
https://git.lsit.ucsb.edu/publicdata/nist-gov
https://git.lsit.ucsb.edu/publicdata/cancer-gov
More on the way!
If you work(ed) in federal government and know of some public websites or data that is likely to be taken down sooner than later, I would appreciate knowing about it so we can prioritize archiving it.
We still have a bunch more on the way, but we prioritize requests and tips over my own inklings.
Where to Find Archived US Government Pages and Data
https://www.wordsbywes.ink/articles/resources/where-to-find-archived-us-government-pages-and-data/
#GovernmentData
#OpenData
#DataArchive
#PublicData
#InformationAccess
USGS Hydrology Technicians Measure Peak Flows After A Recent Storm In West Virginia
--
https://www.usgs.gov/centers/virginia-and-west-virginia-water-science-center/news/usgs-hydrology-technicians-measure <-- shared article
--
#GIS #spatial #mapping #water #hydrology #flood #flooding #highwater #monitoring #streamgauge #gauging #WestVirginia #USGS #Charleston #rainfall #precipitation #extremeweather #opendata #publicdata #highflow #measurements #streamgage #sitevisits #WV #stage #discharge #safety #risk #hazard #environmental #USACE #spatialanalysis #spatiotemporal
@USGS
It's an exciting day for public health data rescue!
Today we added preliminary collected data for:
SAMHSA: https://git.lsit.ucsb.edu/publicdata/samhsa-gov
AHRQ: https://git.lsit.ucsb.edu/publicdata/ahrq-gov
CMS: https://git.lsit.ucsb.edu/publicdata/cms-gov
We also posted significant additions to the cancer.gov and NIH archives:
https://git.lsit.ucsb.edu/publicdata/cancer-gov
https://git.lsit.ucsb.edu/publicdata/nih-gov
Here's a small one but seems important enough - a dump of schoolsafety.gov
If you were hoping to get resources on #malaria, unfortunately, PMI.gov is offline now:
Here's a preliminary dump of public data from the National Institute of Health (NIH).
More on the way!
Here's an archival dump of #cancer dot gov, including sub sites.
It's a small one but seems likely to disappear or be significantly gutted soon, so here's an archival dump of stopbullying dot gov.
Good morning. I significantly expanded the #USDA data archives overnight.
Note that most zip and mp3 files here are now git-lfs stored.
And here's a preliminary archive of data sets and publications from the US Department of Agriculture, including SNAP, chemical use, imports, etc.
And now dumps of the US National Archives and US Government Publications Office data from 1996-2025! See the data.json for metadata for what each file contains.
Note that the archives here (zip, tar) are git-lfs.
https://git.lsit.ucsb.edu/publicdata/us-national-archives-and-publications
A thanks to everyone who's been linking to our publicdata rescue project! I keep seeing links to it show up in more and more places. The infrastructure it's running on is local (not public cloud) and not tied to any NSF funding. That said, I encourage you to clone these repositories if you have plenty of disk space and an unmetered connection. More coming soon!