Not sure I’m even asking the right questions (definitely my google searches are coming empty).
What I want is ideally an intuitive way to chain containers together (e.g. I want one to read up inputs from a telegram bot -> send the link to another that downloads the YouTube video -> depending on the size, for another to move the file around).
There must be solutions to orchestrate all this - can you help me go in the right direction please?
why not just use redis
Don’t over complicate this. Use a single container that runs the bot and can write to a host directory. Have the bot run yt-dlp whenever it finds a youtube link and download to the host directory. For moving the videos based on size you can write code in the bot to do it after download, or you can run a cron job to do it (either in the container or on the host), or maybe yt-dlp has an option for that.
Just use docker-compose? Put multiple containers in one compose file. Create an internal network for them to communicate with.
As far as the general solution to the higher level question asked, this is the way. For the specific application, can certainly question the question of the multiple containers in the first place.
I have a series of containers that use the host network and share messages over MQTT. Works well. One of them launches other containers when specific trigger phrases are said in specific topics. Another one sends trigger phrases based on a schedule.