Skip to content

Add a ConcatenateTransformer #555

Description

@joshua-oss

There are common cases where categorical columns have strong dependencies which are considered public and should be preserved. For example, a table that has State and ZIP code columns should not waste privacy budget generating spurious combinations of state and ZIP code, because the mapping between State and ZIP is public knowledge. This is common with "Star Schema" dimensional designs. One simple way to handle this would be to allow the transformers to concatenate these values together before fitting, and split apart again when transforming.

This is related to #534, because combinations of public dimensions can still fingerprint individuals (and indeed, the risk is higher, because the needed attributes for the fingerprint are public). So the transformer would need to ensure a full cross join, or proper generation of spurious combinations, or alternately redaction with DPSU/DPNE. However, this could be useful.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions