Why Am I Receiving a Duplicate Columns Error?

Use Case

You have received a Duplicate Columns alert on your Fivetran dashboard or have observed a duplicate columns log in the Fivetran Platform Connector's destination schema.

You have checked your source system and cannot identify any duplicate columns.

Recommendation

Change your source system's column naming convention to work within the parameters of Fivetran’s naming conventions.

Context

may identify columns as duplicates even if your source system enforces uniqueness in the naming convention.

For example, consider the following unique column names:

• systemID
• system__ID
• system_ID

One column name uses camel case, one has a double underscore, and one has a single underscore. However, Fivetran normalizes all the column names to the same column name, system_id.

Considerations

There may be scenarios where Fivetran excludes duplicate columns from being written to the destination. If you don’t require the excluded data for your downstream modeling, deselect those columns from your syncs and leave the source naming conventions as they are.