[Bug] Data Inconsistency in RealtimeToOffline Minion tasks

[Harnoor7]

Currently for RTO tasks, watermark is updated in the executor after segments are uploaded. Hence, there can be possible scenarios where segments were uploaded to an offline table but RTO metadata watermark was not updated. AND RTO task generator does not validate if the segment has already been processed in the previous minion run.

Due to above, Offline table can have inconsistent data.

[Harnoor7]

Since created offline segment names for offline table will be same, segments just gets replaced. But if user modifies task config, segment names can change and then we get incorrect query results.