| Tag Databricks resources for cost attribution |
https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags |
| Use default Databricks policy families to enforce compute best practices |
https://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families |
| Apply identity federation best practices in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices |
| Apply best practices for serverless Databricks workspaces |
https://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices |
| Build and refine Knowledge Assistant chatbots on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/agents/agent-bricks/knowledge-assistant |
| Design effective evaluation sets for Databricks agents |
https://learn.microsoft.com/en-us/azure/databricks/agents/agent-evaluation/evaluation-set |
| Load test Databricks Apps agents for QPS limits |
https://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/load-test-agent-app |
| Measure RAG performance with retrieval and response metrics |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-assess-performance |
| Define RAG application quality with evaluation sets |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-define-quality |
| Set up Databricks infrastructure to measure RAG quality |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-enable-measurement |
| Evaluate and monitor RAG applications for quality, cost, latency |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag |
| Design and optimize RAG inference chains on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-inference-chain-rag |
| Build and tune Databricks RAG data pipelines |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-data-pipeline-rag |
| Improve RAG application quality via key tuning knobs |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-overview |
| Optimize RAG chain components for better responses |
https://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-rag-chain |
| Optimize Databricks AI Search performance |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/best-practices |
| Load test Databricks AI Search endpoints for sizing |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/endpoint-load-test |
| Apply Databricks AI Search filter expressions effectively |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/filtering-guide |
| Improve Databricks AI Search retrieval quality |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality |
| Evaluate Databricks AI Search retrieval strategies |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality-eval |
| Detect and clean up unused Databricks AI Search endpoints |
https://learn.microsoft.com/en-us/azure/databricks/ai-search/unused-endpoints |
| Migrate Databricks library installs from init scripts |
https://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts |
| Apply compute policy best practices in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices |
| Use DBIO for transactional writes to cloud storage in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit |
| Optimize skewed joins in Databricks using skew hints |
https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join |
| Migrate from Databricks Deep Learning Pipelines |
https://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines |
| Apply Azure Databricks administration best practices |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration |
| Optimize BI performance with Databricks SQL warehouses |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving |
| Optimize BI performance with Databricks data preparation |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep |
| Configure Databricks SQL warehouses for optimal BI serving |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving |
| Apply Azure Databricks compute creation best practices |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute |
| Implement Azure Databricks production job scheduling best practices |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs |
| Apply Power BI performance best practices with Databricks data |
https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi |
| Apply classic compute configuration best practices in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices |
| Use flexible node types for reliable Databricks compute |
https://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types |
| Apply best practices for Databricks pools |
https://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices |
| Use serverless compute effectively on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices |
| Tune Databricks SQL warehouses for BI workloads |
https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings |
| Control large interactive queries with Query Watchdog |
https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog |
| Optimize Azure Databricks dashboard caching and datasets |
https://learn.microsoft.com/en-us/azure/databricks/dashboards/caching |
| Apply observability best practices for Databricks jobs and pipelines |
https://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices |
| Apply ABAC policy best practices in Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices |
| Optimize performance of ABAC row and column policies |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance |
| Understand ABAC policy evaluation behavior |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/policy-evaluation |
| Apply Unity Catalog data governance best practices |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices |
| Manage Unity Catalog object storage lifecycle and recovery |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/object-storage-lifecycle |
| Apply service policy examples for AI governance |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/service-policies/policy-examples |
| Work with legacy Hive metastore objects in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore |
| Follow DBFS root storage recommendations in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root |
| Apply DBFS and Unity Catalog usage best practices |
https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog |
| Apply Delta Lake best practices on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/delta/best-practices |
| Handle Delta Lake limitations and risks on Amazon S3 |
https://learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations |
| Apply selective overwrite patterns with Delta Lake |
https://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite |
| Apply MLOps Stack best practices with bundles |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks |
| Apply CI/CD workflow best practices on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/flows |
| Apply security and performance best practices for Databricks apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices |
| Test Databricks Connect for Python code with pytest |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing |
| Handle async queries and interruptions in Databricks Connect |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries |
| Apply Databricks developer and CI/CD best practices |
https://learn.microsoft.com/en-us/azure/databricks/developers/best-practices |
| Explore Unity Catalog volumes and storage files in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/discover/files |
| Choose between Databricks volumes and workspace files |
https://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations |
| Curate effective Genie Agents for accuracy |
https://learn.microsoft.com/en-us/azure/databricks/genie-agents/best-practices |
| Apply prompt best practices for Genie Code |
https://learn.microsoft.com/en-us/azure/databricks/genie-code/tips |
| Apply Auto Loader best practices for reliable ingestion |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/best-practices |
| Optimize Databricks Auto Loader directory listing mode |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/directory-listing-mode |
| Configure Databricks Auto Loader for production workloads |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production |
| Configure Auto Loader automatic type widening |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/type-widening |
| Apply common COPY INTO data loading patterns |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples |
| Incrementally clone Parquet and Iceberg tables to Delta |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/clone-parquet |
| Use the Anthropic connector effectively in Lakeflow |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anthropic-faq |
| Apply Lakeflow Connect patterns for managed ingestion |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns |
| Query system.billing.usage to monitor Lakeflow costs |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monitor-costs |
| Maintain Databricks Lakeflow managed ingestion pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance |
| Maintain and operate PostgreSQL ingestion pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance |
| Apply limitations and tuning best practices for query-based connectors |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-limits |
| RabbitMQ connector behavioral FAQs and guidance |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/rabbitmq-faq |
| Filter rows during Lakeflow Connect ingestion |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/row-filtering |
| Optimize incremental ingestion of Salesforce formula fields |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields |
| Optimize Databricks smart closure for CDC pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smart-closure |
| Use and configure init scripts on Azure Databricks clusters |
https://learn.microsoft.com/en-us/azure/databricks/init-scripts/ |
| Reference external files safely in Databricks init scripts |
https://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files |
| Use continuous mode for Databricks streaming jobs |
https://learn.microsoft.com/en-us/azure/databricks/jobs/continuous |
| Apply classic compute best practices for Databricks jobs |
https://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs |
| Apply Databricks cost optimization best practices |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices |
| Apply Databricks data and AI governance best practices |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices |
| Design compute and workspace configuration for Databricks |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute |
| Design observability and monitoring for Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability |
| Apply interoperability and usability best practices in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices |
| Apply operational excellence best practices for Databricks |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices |
| Optimize Databricks performance with efficiency best practices |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices |
| Apply reliability best practices on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices |
| Implement Databricks security, compliance, and privacy best practices |
https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices |
| Classify documents with large label taxonomies in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/large-language-models/classify-documents-labels-tutorial |
| Optimize Lakeflow clusters with enhanced and vertical autoscaling |
https://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling |
| Apply Lakeflow pipeline best practices in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices |
| Handle compatibility issues with pipeline environment versions |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/environment-version-compatibility |
| Apply data quality expectations in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-expectations |
| Apply advanced expectation patterns in Lakeflow |
https://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns |
| Reduce high initialization times in Lakeflow pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init |
| Design REPLACE USING flows for partial snapshots in Lakeflow |
https://learn.microsoft.com/en-us/azure/databricks/ldp/flows-replace-using |
| Use from_json for schema inference in Lakeflow |
https://learn.microsoft.com/en-us/azure/databricks/ldp/from-json-schema-evolution |
| Run full refreshes on Lakeflow streaming tables safely |
https://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st |
| Optimize stateful streaming with watermarks in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing |
| Implement CDC ETL pipelines with Lakeflow and Auto Loader |
https://learn.microsoft.com/en-us/azure/databricks/ldp/tutorial-pipelines |
| Build geospatial Lakeflow pipelines with native spatial types |
https://learn.microsoft.com/en-us/azure/databricks/ldp/tutorial-spatial-pipelines |
| Unit test Lakeflow pipelines with mock data |
https://learn.microsoft.com/en-us/azure/databricks/ldp/unit-testing |
| Restart the Python process to refresh Databricks libraries |
https://learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process |
| Apply performance and resiliency patterns on AI Runtime |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides/performance-and-resiliency |
| Apply Hyperopt best practices on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices |
| Implement point-in-time correct feature joins |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series |
| Benchmark Databricks LLM endpoints for performance |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark |
| Apply Databricks batch model inference patterns |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/ |
| Validate models before Databricks serving deployment |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation |
| Monitor Databricks model quality and endpoint health |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints |
| Optimize Databricks Model Serving endpoints for production |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization |
| Plan and execute load testing for Databricks serving endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test |
| Tune and autoscale Ray clusters on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray |
| Apply deep learning best practices on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices |
| Adapt Apache Spark workloads for Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/migration/spark |
| Log model dependencies for reproducible deployments |
https://learn.microsoft.com/en-us/azure/databricks/mlflow/log-model-dependencies |
| Apply MLflow 3 best practices for GenAI observability |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/ |
| Align MLflow judges with human feedback |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges |
| Evaluate and compare MLflow prompt versions for GenAI |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts |
| Apply MLflow Tracing for GenAI observability |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/ |
| Use manual MLflow tracing for production GenAI apps |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/ |
| Collect and log user feedback on GenAI traces with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/collect-user-feedback/ |
| Analyze GenAI traces with MLflow Trace SDK |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces |
| Apply software engineering practices to Databricks notebooks |
https://learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices |
| Run Databricks notebooks safely and efficiently |
https://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook |
| Apply unit testing patterns in Databricks notebooks |
https://learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks |
| Optimize OpenSharing egress costs for data providers |
https://learn.microsoft.com/en-us/azure/databricks/opensharing/manage-egress |
| Apply performance optimization recommendations on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/ |
| Use adaptive query execution on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe |
| Migrate away from deprecated Bloom filter indexes |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/bloom-filters |
| Optimize Spark SQL queries with Databricks CBO |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/cbo |
| Improve read performance with Databricks disk cache |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache |
| Improve Delta query performance with dynamic file pruning |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning |
| Choose and configure Databricks Delta isolation levels |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/isolation-levels |
| Use row-level concurrency to reduce Delta write conflicts |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/row-level-concurrency |
| Optimize Delta MERGE performance with low shuffle merge |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/low-shuffle-merge |
| Use predictive I/O optimizations on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io |
| Optimize Azure Databricks range join performance |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join |
| Diagnose Databricks Spark cost and performance in UI |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/ |
| Diagnose high I/O Spark stages using Databricks UI |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io |
| Debug skew and spill in Databricks Spark stages |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page |
| Handle Databricks spot instance losses effectively |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances |
| Resolve long Spark stages with a single task |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task |
| Optimize many small Spark jobs on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs |
| Mitigate overloaded Spark driver on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded |
| Detect unnecessary data rewriting in Databricks Spark writes |
https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data |
| Apply Partner Connect setup best practices in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice |
| Handle to_utc_timestamp semantics in Spark Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_utc_timestamp |
| Apply networking recommendations for Lakehouse Federation |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/networking |
| Optimize performance of Lakehouse Federation queries |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations |
| Understand Databricks Runtime 14.3 LTS changes |
https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.3lts |
| Leverage Databricks Runtime 15.4 LTS updates |
https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/15.4lts |
| Use Databricks Runtime 18 LTS changes and fixes |
https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/18 |
| Apply Databricks Runtime 19 feature and fix details |
https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/19 |
| Transform complex and nested data types in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types |
| Use higher-order functions on arrays in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions |
| Use VARIANT instead of JSON strings in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff |
| Convert Parquet tables to Delta Lake in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-convert-to-delta |
| Optimize Delta Lake table layout with Databricks OPTIMIZE |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-optimize |
| Vacuum unused files from Delta and Spark tables |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-vacuum |
| Apply partitioning and liquid clustering best practices in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-partition |
| Use ANALYZE TABLE statistics for Databricks optimization |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics |
| Use Databricks SQL query hints for performance |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-hints |
| Use OFFSET and LIMIT safely for pagination in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-offset |
| Benchmark Databricks SQL warehouses with the TPC-DS dataset |
https://learn.microsoft.com/en-us/azure/databricks/sql/tpcds-eval |
| Author effective SQL patterns for Databricks alerts |
https://learn.microsoft.com/en-us/azure/databricks/sql/user/alerts/query-patterns |
| Optimize Databricks SQL queries with RELY constraints |
https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints |
| Operate multiple Databricks streaming queries per cluster |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/multiple-streams |
| Run Databricks Structured Streaming in production |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production |
| Optimize and monitor Databricks real-time streaming performance |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance |
| Optimize and manage stateful Structured Streaming on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateful-streaming |
| Optimize stateless Structured Streaming queries on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming |
| Monitor Structured Streaming queries on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stream-monitoring |
| Tune Databricks Structured Streaming trigger intervals |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/triggers |
| Apply watermarks for stateful streaming on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks |
| Use automatic upgrades for Unity Catalog tables |
https://learn.microsoft.com/en-us/azure/databricks/tables/automatic-upgrades |
| Optimize Databricks tables using liquid clustering |
https://learn.microsoft.com/en-us/azure/databricks/tables/clustering |
| Leverage data skipping on Databricks tables |
https://learn.microsoft.com/en-us/azure/databricks/tables/data-skipping |
| Optimize external table partition discovery in Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/tables/external-partition-discovery |
| Optimize Azure Databricks VARIANT columns with shredding |
https://learn.microsoft.com/en-us/azure/databricks/tables/features/variant-shredding |
| Use table history and time travel safely in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/tables/history |
| Optimize Delta and Iceberg table file layout |
https://learn.microsoft.com/en-us/azure/databricks/tables/operations/optimize |
| Vacuum unused data files in Delta and Iceberg tables |
https://learn.microsoft.com/en-us/azure/databricks/tables/operations/vacuum |
| Interpret table size versus storage usage |
https://learn.microsoft.com/en-us/azure/databricks/tables/size |
| Tune Delta and Iceberg data file sizes in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/tables/tune-file-size |
| Safely evolve Delta and Iceberg table schemas |
https://learn.microsoft.com/en-us/azure/databricks/tables/update-schema |
| Design Delta Lake data models on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling |
| Optimize join performance in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins |
| Implement data cleaning and validation on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/transform/validate |
| Use level of detail expressions in metric views |
https://learn.microsoft.com/en-us/azure/databricks/uc-semantics/metric-views/level-of-detail |
| Define session-scoped Scala and Java UDFs in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/udf/scala |
| Download internet data into Azure Databricks volumes |
https://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files |
