This might be an old discussion topic and hopefully you guys can be able to point me to the right direction.
I have a single sql table that has information of bus location logs for a given time period. I want to work out a flow that will run some calculations per bus per day. So it is a table with millions of records and I was thinking of breaking the table into separate ones per day to be manageable. I've queried a single day table and I got like 1k unique bus numbers. I am wondering if its ok to create a dictionary having the bus number as key and its value would be the list of all its location logs. Wondering if this is the most practical way to go about it.