push down the dedup to the data source and then merge the results localy
push down the dedup to the data source and then merge the results localy