I ended up with a PostgreSQL query that takes 1.5h to transform a data set of 6GB.
Feels like an eternity.
https://gist.github.com/smarr/5a30c34cc38e274f634b151d9763f93c
@smarr indexes are your friend :)
@freemo hm, I would assume there's an index on the primary key:
https://github.com/smarr/ReBenchDB/blob/2414426bb93a9c170004a97207593217f02f622b/src/backend/db/db.sql#L152
Would you have a suggestion what other indexes might be helpful here? Thanks.
@smarr aorry just saw this. Taggi g my main accou t so i can read and answer you tomorrow.