Microsoft Azure Synapse Analytics is an enterprise analytics service that enables insight across data warehouses and big data systems.
Extracted notebook objects
Metadata Command Center extracts the following notebook objects from a Microsoft Azure Synapse Analytics source system:
•Calculation
•Cell
•Folder
•Notebook Definition
•Notebook Instance
•Workspace
You can extract metadata from Microsoft Azure Synapse Analytics notebooks with the following programming languages:
•Python
•SQL
You can extract metadata from Microsoft Azure Synapse Analytics notebooks with the following Python functionalities:
•Standard language constructions
•Standard built-in functions
•Partially-compatible modules:
Note: Data Governance and Catalog processes only a subset of library functions of partially-compatible modules.
- abs
- adal
- argparse
- array
- ast
- azure
- base64
- binascii
- calendar
- codecs
- collections
- concurrent
- contextlib
- contextvars
- copy
- copyreg
- csv
- dataclasses
- datetime
- decimal
- delta
- difflib
- distutils
- email
- enum
- errno
- fnmatch
- fractions
- functools
- gc
- genericpath
- gettext
- glob
- graphframes
- hashlib
- heapq
- hmac
- importlib
- inspect
- io
- itertools
- json
- keyword
- locale
- logging
- math
- matplotlib
- mssparkutils
- nt
- numbers
- numpy
- operator
- os
- pandas
- pathlib
- pickle
- pkgutil
- posix
- posixpath
- pprint
- py4j
- pyodbc
- pyspark
- pytz
- random
- re
- reprlib
- requests
- seaborn
- secrets
- shutil
- simplejson
- six
- sklearn
- smtplib
- socket
- ssl
- stat
- string
- struct
- subprocess
- sys
- teradatasql
- textwrap
- threading
- time
- traceback
- types
- typing
- urllib
- urllib3
- uuid
- warnings
- weakref
- xml
- yaml
- zipfile
- zlib
•Custom libraries
Note: Custom libraries are libraries created by a user.
If a Microsoft Azure Synapse Analytics catalog source detects an incompatible function or library, it can't process the statement. It skips the statement and continues to process the next one.
Extracted pipeline objects
Metadata Command Center extracts the following pipeline objects from a Microsoft Azure Synapse Analytics source system:
•Activity
•Activity Instance
•Calculation
•Folder
•Pipeline
•Pipeline Instance
•Workspace
The Microsoft Azure Synapse Analytics catalog source is compatible with the following Pipeline Activity and Dataset components:
Component name
Description
Copy
Pipeline activity
ExecuteDataFlow
Pipeline activity.
ExecuteSSISPackage
Pipeline activity.
Supported page locations:
- File System (Package)
- Embedded Package
GetMetadata
Pipeline activity
Lookup
Pipeline activity
SqlServerStoredProcedure
Pipeline activity
IfCondition
Pipeline activity
Switch
Pipeline activity
Until
Pipeline activity
ForEach
Pipeline activity
Wait
Pipeline activity
SetVariable
Pipeline activity
ExecutePipeline
Pipeline activity
WebActivity
Pipeline activity
DatabricksNotebook
Pipeline activity
Binary
Dataset
DelimitedText
Dataset
Excel
Dataset
Json
Dataset
Parquet
Dataset
FileShare
Dataset
AmazonRedshiftTable
Dataset
AzureSqlDWTable
Dataset
AzureSqlTable
Dataset
DynamicsCrmEntity
Dataset
OracleTable
Dataset
SalesforceObject
Dataset
SnowflakeTable
Dataset
SqlServerTable
Dataset
AzureDatabricksDeltaLakeDataset
Dataset
Data Lineage
The following lineage data is available for Microsoft Azure Synapse Analytics assets:
•Data Set Level
•Data Element Level
For more information about data lineage, see Data Lineage in the Asset Discovery help.