Distinct Node
Description
Use the Distinct node to remove duplicate rows. By default, all the columns will be used to compare rows, to decide if there are duplicate values.
Options
- Subset: you can choose to compare only a subset of columns.
Tips
- If a subset of columns are not defined, this node will only remove rows where every column is identical to another row
SQL Equivalent
select distinct *
from {data_source}
Updated on: 05/10/2024
Thank you!