What are some good publicly available real-time data sources?
What (preferably free) API's are preferred for 'real-time' stock data?
visualization - Whats are some real time data sources? - Stack Overflow
'Free' API in 2024?
Videos
I am attempting to source via the wisdom of the crowd here. I often find it hard to find good real-time data sources for learning about streaming, prototyping, or building hobby projects. I started researching and then created an "Awesome List" in a GitHub repo - https://github.com/bytewax/awesome-public-real-time-datasets.
Does anyone have a good source I should add to this list?
Yes, I know it's been asked 17 million times. The problem is, there are 58 million answers and the vast majority of them are sarcastic, rhetorical, or a simple "try this platform" without explanation of why.
I'm mostly just wanting an API that integrates well with Python that provides as real-time information as possible for a single stock symbol at a time. I believe my current usage is somewhere around 100 call/min IF I happen to be holding a stock. My calls per day is significantly lighter. I would prefer a free version, but I wouldn't mind paying a little bit if it was significantly more consistent and up to date.
Here are some that I have tried and problems I've had with them:
- yFinance seems to be delayed a little bit, but there's another weird thing going on. I've run 2 functionally identical programs side-by-side and one of them will start pulling the new price a good 20+ seconds before the other one, which is kinda a lot!
-Alpaca (free) seems to update slower than yFinance, which is odd given what I've been able to find with a google search. It also held the 'current price' at the Open of the minute that a particular stock was halted and not the Last (or Close) price when the halt was initiated. It also didn't update until 30s after trading was resumed.
Again, I'm not particularly opposed to paying a bit for 'live' data IF that data is truly "real-time" (meaning within the last couple seconds) (Alpaca does not) and returns the properly updated value with each API call (yFinance does not).
yFinance price changes are underlined in red. Both programs were running on the same machine in parallel and made a new API call every time it wrote to the logs. Timestamps are in Central time.Just some thoughts:
Environmental Datasets
As stated by the other comment, have a look to weather, forecast (or similar services).
Space data
What about data from the Universe?
Flights
Here's some real time flight tracking data: the evaluation plan is limited but free.
Social Networks
Twitter Streaming API, Facebook RealTime Updates API (in case you hyave already an app on the social Network), Foursquare
Energy production
Various energy production (real-time and quasi real-time) data.
On these ones probably you have to fiddle around the pages to track the sources of the data, sorry.
Website traffic
Google Analytics RealTime API (for your registered websites)
Money
Bitcoin transactions, Stock Market API
More?
And here and here an "not-so-updated" list of other Real-Time API services (some free, some others not).
Have you considered environmental datasets?
For one, there are near real time (say, hourly or 15m) data on streamflow and water quality. There's also a wealth of weather data served up via NOAA NCDC and APIs. How about some bouy data?
Seeing this post reminded me that there's lots of flight tracking data out there which could be fun to visualize too.