Open-source GitHub Repo | Paper Describing the Process

Aside: If you want to take the course I did online, the full course is available for free on YouTube.

When I was a graduate student at Carnegie Mellon University, I took this course called Intro to Deep Learning. Don't let the name of this course fool you; it was absolutely one of the hardest and most interesting classes I've taken in my entire life. In that class, I fully learned what "AI" actually means. I learned how to create state-of-the-art AI algorithms – including training them from scratch using AWS EC2 clusters.

But, I loved it. At this time, I was also a trader. I had aspirations of creating AI-Powered bots that would execute trades for me.

And I had heard of "reinforcement learning" before.. I took an online course at the University of Alberta and received a certificate. But I hadn't worked with "Deep Reinforcement Learning" – combining our most powerful AI algorithm (deep learning) with reinforcement learning

So, when my Intro to Deep Learning class had a final project in which I could create whatever I wanted, I decided to make a Deep Reinforcement Learning Trading Bot.

Background: What is Deep Reinforcement Learning

Deep Reinforcement Learning (DRL) involves a series of structured steps that enable a computer program, or agent, to learn optimal actions within a given environment through a process of trial and error. Here’s a concise breakdown:

1. Initialize: Start with an agent that has no knowledge of the environment, which could be anything from a game interface to financial markets.

2. Observe: The agent observes the current state of the environment, such as stock prices or a game screen.

3. Decide: Using its current policy, which initially might be random, the agent selects an action to perform.

4. Act and Transition: The agent performs the action, causing the environment to change and generate a new state, along with a reward (positive or negative).

5. Receive Reward: Rewards inform the agent about the effectiveness of its action in achieving its goals.

6. Learn: The agent updates its policy using the experience (initial state, action, reward, new state), typically employing algorithms like Q-learning or policy gradients to refine decision-making towards actions that yield higher returns.

7. Iterate: This cycle repeats, with the agent continually refining its policy to maximize cumulative rewards.

This iterative learning approach allows DRL agents to evolve from novice to expert, mastering complex decision-making tasks by optimizing actions based on direct interaction with their environment.

How I applied it to the stock market

My team implemented a series of algorithms that modeled financial markets as a deep reinforcement learning problem. While I won't be super technical in this post, you can read exactly what we did here. Some of the interesting experiments we tried included using convolutional neural networks to generate graphs, and use the images as features for the model.

However, despite the complexity of the models we built, none of the models were able to develop a trading strategy on SPY that outperformed Buy and Hold.

I'll admit the code is very ugly (we were scramming to find something we could write in our paper and didn't focus on code quality). But if people here are interested in AI beyond Large Language Models, I think this would be an interesting read.

Open-source GitHub Repo | Paper Describing the Process

Happy to get questions on what I learned throughout the experience!

Guys,

I develop new open-source swing and position trading bot based on unofficial Robinhood API. Currently implemented features include:

• Fully-automated technical-analysis-based trading approach

• "Paper" trading mode, just suggesting what's to buy, sell, hold and which -stops should be

• Risk management based portfolio allocation

• Configurable (trailing) profit stops automatic allocation

• Earnings announcements impacts

• Market breadth analysis

• User defined strategies

• Fundamental analysis

• Last year backtest

https://github.com/yura505/robinbot

I'm looking for contributors and anyone who interesting in it. My goal is create high profitable swing trading bot which can outperform market with reasonable risks.

Ready for comments, issues and wishes :)

For the past few years, I've been working on a personal project born out of my own frustration. I'm into algorithmic trading, and I found it difficult to cleanly deploy, manage, and backtest multiple bots without relying on expensive cloud services or clunky setups.

I couldn't find an open-source tool that fit my needs, so I built one. It's called the0, and it's a Docker-powered platform for orchestrating trading bots. It's language-agnostic (Python/JS supported for now) and handles the scheduling, container deployment, and monitoring so you can focus on the strategy.

The entire project is now 100% free and open-source. I'm no longer pursuing it as a commercial product and just want to build it for the community.

GitHub Repo: https://github.com/alexanderwanyoike/the0

I'd love to get some feedback from experienced self-hosters, specifically on:

• The overall architecture (diagrams are in the repo). Does it seem sound?

• How difficult is the setup process? I'm trying to make it as smooth as possible.

• Are there any obvious features missing for a platform like this?

Thanks for taking a look!