Skip to main content

Tableau

Incubating

Important Capabilities​

CapabilityStatusNotes
Dataset Usage✅Dashboard/Chart view counts, enabled using extract_usage_stats config
Descriptions✅Enabled by default
Detect Deleted Entities✅Enabled by default when stateful ingestion is turned on.
Domains❌Requires transformer
Extract Ownership✅Requires recipe configuration
Extract Tags✅Requires recipe configuration
Platform Instance✅Enabled by default
Table-Level Lineage✅Enabled by default

Prerequisites​

In order to ingest metadata from Tableau, you will need:

  • Tableau Server Version 2021.1.10 and above. It may also work for older versions.
  • Enable the Tableau Metadata API for Tableau Server, if its not already enabled.
  • Tableau Credentials (Username/Password or Personal Access Token)
  • The user or token must have Site Administrator Explorer permissions.

Ingestion through UI​

The following video shows you how to get started with ingesting Tableau metadata through the UI.

Integration Details​

This plugin extracts Sheets, Dashboards, Embedded and Published Data sources metadata within Workbooks in a given project on a Tableau site. Tableau's GraphQL interface is used to extract metadata information. Queries used to extract metadata are located in metadata-ingestion/src/datahub/ingestion/source/tableau_common.py

Concept Mapping​

This ingestion source maps the following Source System Concepts to DataHub Concepts:

Source ConceptDataHub ConceptNotes
"Tableau"Data Platform
ProjectContainerSubType "Project"
Embedded DataSourceDatasetSubType "Embedded Data Source"
Published DataSourceDatasetSubType "Published Data Source"
Custom SQL TableDatasetSubTypes "View", "Custom SQL"
Embedded or External TablesDataset
SheetChart
DashboardDashboard
UserUser (a.k.a CorpUser)Optionally Extracted
WorkbookContainerSubType "Workbook"
TagTagOptionally Extracted

Lineage​

Lineage is emitted as received from Tableau's metadata API for

  • Sheets contained within a Dashboard
  • Embedded or Published Data Sources depended on by a Sheet
  • Published Data Sources upstream to Embedded datasource
  • Tables upstream to Embedded or Published Data Source
  • Custom SQL datasources upstream to Embedded or Published Data Source
  • Tables upstream to Custom SQL Data Source

Caveats​

  • Tableau metadata API might return incorrect schema name for tables for some databases, leading to incorrect metadata in DataHub. This source attempts to extract correct schema from databaseTable's fully qualified name, wherever possible. Read Using the databaseTable object in query for caveats in using schema attribute.

Troubleshooting​

Why are only some workbooks/custom SQLs/published datasources ingested from the specified project?​

This may happen when the Tableau API returns NODE_LIMIT_EXCEEDED error in response to metadata query and returns partial results with message "Showing partial results. , The request exceeded the ‘n’ node limit. Use pagination, additional filtering, or both in the query to adjust results." To resolve this, consider

  • reducing the page size using the page_size config param in datahub recipe (Defaults to 10).
  • increasing tableau configuration metadata query node limit to higher value.

CLI based Ingestion​

Install the Plugin​

pip install 'acryl-datahub[tableau]'

Starter Recipe​

Check out the following recipe to get started with ingestion! See below for full configuration options.

For general pointers on writing and running a recipe, see our main recipe guide.

source:
  type: tableau
  config:
    # Coordinates
    connect_uri: https://prod-ca-a.online.tableau.com
    site: acryl
    platform_instance: acryl_instance
    project_pattern: ["^default$", "^Project 2$", "^/Project A/Nested Project B$"]

    # Credentials
    username: "${TABLEAU_USER}"
    password: "${TABLEAU_PASSWORD}"

    # Options
    ingest_tags: True
    ingest_owner: True
    default_schema_map:
      mydatabase: public
      anotherdatabase: anotherschema

sink:
  # sink configs

Config Details​

Note that a . is used to denote nested fields in the YAML recipe.

FieldDescription
connect_uri ✅
string
Tableau host URL.
default_schema_map
object
Default schema to use when schema is not found.
Default: {}
extract_column_level_lineage
boolean
When enabled, extracts column-level lineage from Tableau Datasources
Default: True
extract_lineage_from_unsupported_custom_sql_queries
boolean
[Experimental] Whether to extract lineage from unsupported custom sql queries using SQL parsing
Default: False
extract_project_hierarchy
boolean
Whether to extract entire project hierarchy for nested projects.
Default: True
extract_usage_stats
boolean
[experimental] Extract usage statistics for dashboards and charts.
Default: False
ingest_embed_url
boolean
Ingest a URL to render an embedded Preview of assets within Tableau.
Default: False
ingest_external_links_for_charts
boolean
Ingest a URL to link out to from charts.
Default: True
ingest_external_links_for_dashboards
boolean
Ingest a URL to link out to from dashboards.
Default: True
ingest_owner
boolean
Ingest Owner from source. This will override Owner info entered from UI
Default: False
ingest_tables_external
boolean
Ingest details for tables external to (not embedded in) tableau as entities.
Default: False
ingest_tags
boolean
Ingest Tags from source. This will override Tags entered from UI
Default: False
page_size
integer
[advanced] Number of metadata objects (e.g. CustomSQLTable, PublishedDatasource, etc) to query at a time using the Tableau API.
Default: 10
password
string
Tableau password, must be set if authenticating using username/password.
platform_instance
string
The instance of the platform that all assets produced by this recipe belong to
platform_instance_map
map(str,string)
project_path_separator
string
The separator used for the project_pattern field between project names. By default, we use a slash. You can change this if your Tableau projects contain slashes in their names, and you'd like to filter by project.
Default: /
projects
array(string)
site
string
Tableau Site. Always required for Tableau Online. Use emptystring to connect with Default site on Tableau Server.
Default:
ssl_verify
One of boolean, string
Whether to verify SSL certificates. If using self-signed certificates, set to false or provide the path to the .pem certificate bundle.
Default: True
token_name
string
Tableau token name, must be set if authenticating using a personal access token.
token_value
string
Tableau token value, must be set if authenticating using a personal access token.
username
string
Tableau username, must be set if authenticating using username/password.
workbook_page_size
integer
[advanced] Number of workbooks to query at a time using the Tableau API.
Default: 1
env
string
Environment to use in namespace when constructing URNs.
Default: PROD
lineage_overrides
TableauLineageOverrides
Mappings to change generated dataset urns. Use only if you really know what you are doing.
lineage_overrides.database_override_map
map(str,string)
lineage_overrides.platform_override_map
map(str,string)
project_pattern
AllowDenyPattern
Filter for specific Tableau projects. For example, use 'My Project' to ingest a root-level Project with name 'My Project', or 'My Project/Nested Project' to ingest a nested Project with name 'Nested Project'. By default, all Projects nested inside a matching Project will be included in ingestion. You can both allow and deny projects based on their name using their name, or a Regex pattern. Deny patterns always take precedence over allow patterns. By default, all projects will be ingested.
Default: {'allow': ['.*'], 'deny': [], 'ignoreCase': True}
project_pattern.allow
array(string)
project_pattern.deny
array(string)
project_pattern.ignoreCase
boolean
Whether to ignore case sensitivity during pattern matching.
Default: True
stateful_ingestion
StatefulStaleMetadataRemovalConfig
Base specialized config for Stateful Ingestion with stale metadata removal capability.
stateful_ingestion.enabled
boolean
The type of the ingestion state provider registered with datahub.
Default: False
stateful_ingestion.ignore_new_state
boolean
If set to True, ignores the current checkpoint state.
Default: False
stateful_ingestion.ignore_old_state
boolean
If set to True, ignores the previous checkpoint state.
Default: False
stateful_ingestion.remove_stale_metadata
boolean
Soft-deletes the entities present in the last successful run but missing in the current run with stateful_ingestion enabled.
Default: True

Code Coordinates​

  • Class Name: datahub.ingestion.source.tableau.TableauSource
  • Browse on GitHub

Questions

If you've got any questions on configuring ingestion for Tableau, feel free to ping us on our Slack.