azure blob storage writing management pyspark azure file format logging scheduling transformation data engineering data quality aerospace industry power bi microsoft sql server warehousing onboarding integration information technology analytics store microsoft azure brinell scale business intelligence development data pipeline business intelligence development studio devops metadata snowflake azure data factory azure data lake business intelligence electronics dimensional modeling azure cosmos db python mapping communications execution time databricks scala unpivot