Brandon Rohrer on Nostr: A thing I learned about synchronization in real-time reinforcement learning ...
A thing I learned about synchronization in real-time reinforcement learning
Synchronization between agents in worlds gets trickier when the world is operating in real time, as with robots and other physical systems. In non real-time RL, the world can wait for the agent to plan its next action. It is a turn-taking scenario where the agent waits for the world to make its next move and vice versa. But for physical hardware, the world doesn't wait for the agent to compute.
1/
Synchronization between agents in worlds gets trickier when the world is operating in real time, as with robots and other physical systems. In non real-time RL, the world can wait for the agent to plan its next action. It is a turn-taking scenario where the agent waits for the world to make its next move and vice versa. But for physical hardware, the world doesn't wait for the agent to compute.
1/