You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Microsoft Fabric Livy API lets users submit and execute Spark code within Spark compute associated with a Fabric Lakehouse, eliminating the need to create any Notebook or Spark Job Definition artifacts. This integration with the Lakehouse ensures straightforward access to data stored on OneLake.
The Fabric Livy API allows submitting jobs in two different modes:
@@ -30,7 +28,9 @@ The Fabric Livy API allows submitting jobs in two different modes:
30
28
31
29
## Get started with the Livy API
32
30
33
-
Learn how to [Create and run Spark jobs using the Livy API in Fabric](get-started-api-livy.md) by choosing either a [Submit Spark session jobs using the Livy API](get-started-api-livy-session.md) or a [Submit Spark batch jobs using the Livy API](get-started-api-livy-batch.md).
31
+
Learn how to [Create and run Spark jobs using the Livy API in Fabric](get-started-api-livy.md):
32
+
-[Submit Spark session jobs using the Livy API](get-started-api-livy-session.md)
33
+
-[Submit Spark batch jobs using the Livy API](get-started-api-livy-batch.md).
Copy file name to clipboardExpand all lines: docs/data-engineering/get-started-api-livy.md
+2-4Lines changed: 2 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,12 +1,12 @@
1
1
---
2
2
title: Create and run Spark Session jobs using the Livy API
3
3
description: Learn how to submit and run Spark session jobs in Fabric using the Livy API.
4
-
ms.reviewer: sngun
4
+
ms.reviewer: avinandac
5
5
ms.author: eur
6
6
author: eric-urban
7
7
ms.topic: conceptual
8
8
ms.search.form: Get started with the Livy API for Data Engineering
9
-
ms.date: 04/30/2025
9
+
ms.date: 11/05/2025
10
10
---
11
11
12
12
# Use the Livy API to submit and execute Spark session jobs with user credentials
@@ -15,8 +15,6 @@ ms.date: 04/30/2025
15
15
16
16
Get started with Livy API for Fabric Data Engineering by creating a Lakehouse; authenticating with a Microsoft Entra token; discover the Livy API endpoint; submit either batch or session jobs from a remote client to Fabric Spark compute; and monitor the results.
Copy file name to clipboardExpand all lines: docs/data-warehouse/create-manage-warehouse-snapshot.md
+5-6Lines changed: 5 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,21 +1,18 @@
1
1
---
2
-
title: Create and Manage a Warehouse Snapshot (Preview)
2
+
title: Create and Manage a Warehouse Snapshot
3
3
description: Learn how to create, use, and manage warehouse snapshots in Fabric Data Warehouse.
4
4
author: WilliamDAssafMSFT
5
5
ms.author: wiassaf
6
6
ms.reviewer: twcyril
7
-
ms.date: 05/08/2025
7
+
ms.date: 11/10/2025
8
8
ms.service: fabric
9
9
ms.topic: how-to
10
10
ms.search.form: Manage warehouse snapshots
11
11
---
12
-
# Create and manage a warehouse snapshot (preview)
12
+
# Create and manage a warehouse snapshot
13
13
14
14
This article includes steps to create and manage warehouse snapshots using the Fabric portal, T-SQL queries, or the [Fabric API](/rest/api/fabric/articles/).
15
15
16
-
> [!NOTE]
17
-
> Warehouse snapshots are currently a [preview feature](../fundamentals/preview.md).
18
-
19
16
## Prerequisites
20
17
21
18
- A Fabric workspace with an active capacity or trial capacity.
@@ -124,6 +121,8 @@ The `ALTER DATABASE` SQL statement uses the system time of the warehouse as the
124
121
SETTIMESTAMP='2025-04-27T18:10:00.00';
125
122
```
126
123
124
+
Warehouse snapshots can also be updated via the Fabric portal. In the ribbon, under **Management**, select **Manage warehouse snapshot**.
125
+
127
126
## Rename
128
127
129
128
You can rename a warehouse snapshot item via REST API and in the Fabric portal.
A warehouse snapshot is a read-only representation of a warehouse item at a specific point in time, retained to up to 30 days. To get started, [create a warehouse snapshot](create-manage-warehouse-snapshot.md).
17
17
18
-
> [!NOTE]
19
-
> Warehouse snapshots are currently a [preview feature](../fundamentals/preview.md).
20
-
21
18
Warehouse snapshots can be seamlessly "rolled forward" on demand, allowing consumers to connect to the same snapshot or use a consistent warehouse connection string to access a past version of the data. When the snapshot timestamp is rolled forward, updates are applied immediately, as if in a single, atomic transaction. Warehouse snapshot ensures that data engineers can provide analytical users with a consistent dataset, even as real-time updates occur. Analysts can run `SELECT` queries based on the snapshot without any ETL interference.
22
19
23
20
A snapshot can be useful in scenarios where an ETL process might have created data corruption. This read only child item provides stability and consistency for data that could otherwise be modified by some ETL processes.
@@ -72,10 +69,8 @@ When a T-SQL query is run, information about the current version of the data bei
72
69
- Warehouse snapshots don't exist without the source warehouse. When the warehouse is deleted, all snapshots are deleted. Warehouse snapshots must be recreated if the warehouse is restored.
73
70
- Warehouse snapshots are valid for up to 30 days in the past. Snapshot datetime can be set to any date in the past up to 30 days or database creation time (whichever is later).
74
71
75
-
## Limitations
72
+
## Remarks
76
73
77
-
- Warehouse snapshots can only be created against new warehouse items created after March 2025.
78
-
- Warehouse snapshots don't appear in SSMS Object Explorer but do show up in the database selection dropdown list.
79
74
- Modified tables, views, and stored procedures after the snapshot timestamp become invalid in the snapshot.
80
75
- Warehouse snapshots require Direct Query or Import mode in Power BI, and don't support [Direct Lake](../fundamentals/direct-lake-overview.md) mode.
81
76
- Warehouse snapshots aren't supported on the SQL analytics endpoint of the Lakehouse.
@@ -89,4 +84,4 @@ When a T-SQL query is run, information about the current version of the data bei
89
84
## Related content
90
85
91
86
-[Query data as it existed in the past](time-travel.md)
92
-
-[Create a sample Warehouse in Microsoft Fabric](create-warehouse-sample.md)
87
+
-[Create a sample Warehouse in Microsoft Fabric](create-warehouse-sample.md)
Copy file name to clipboardExpand all lines: docs/fundamentals/whats-new.md
+3-2Lines changed: 3 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Learn about the new features and documentation improvements for Mic
4
4
author: WilliamDAssafMSFT
5
5
ms.author: wiassaf
6
6
ms.reviewer: sngun
7
-
ms.date: 11/06/2025
7
+
ms.date: 11/10/2025
8
8
ms.update-cycle: 30-days
9
9
ms.topic: whats-new
10
10
ms.collection:
@@ -133,7 +133,6 @@ The following table lists the features of Microsoft Fabric that are currently in
133
133
|**Tabbed navigation for multitasking and other UI improvements**|Fabric now supports tabs to open multiple items and easily switch between them. It offers an object explorer that lets you browse and open items across all your open workspaces. To learn more, see [tabbed navigation in Fabric portal](./fabric-home.md#multitask-with-tabs-and-object-explorer) and [New Multitasking Features coming to Fabric (Preview)](https://blog.fabric.microsoft.com/blog/supercharge-your-workflow-new-multitasking-features-coming-to-fabric?ft=All).|
134
134
|**Upsert to delta table with Lakehouse connector (Preview)**|We've added upsert support to the Lakehouse connector, allowing direct writes to Delta tables, in both Copy job and Copy activity within Pipeline. For more information, see [Configure Lakehouse in a copy activity](../data-factory/connector-lakehouse-copy-activity.md#destination).|
135
135
|**varchar(max) and varbinary(max) support in preview**|Support for the **varchar(max)** and **varbinary(max)**[data types](../data-warehouse/data-types.md) in Fabric Data Warehouse is now in preview. For more information, see [Announcing public preview of VARCHAR(MAX) and VARBINARY(MAX) types in Fabric Data Warehouse](https://blog.fabric.microsoft.com/blog/announcing-public-preview-of-varcharmax-and-varbinarymax-types-in-fabric-datawarehouse/).|
136
-
|**Warehouse snapshots (preview)**|[Warehouse snapshots](https://blog.fabric.microsoft.com/blog/warehouse-snapshots-in-microsoft-fabric-public-preview?ft=All) are a point-in-time, read-only representation of your data warehouse. You can create a [snapshot of your warehouse](../data-warehouse/warehouse-snapshot.md) at any point in the past 30 days, connect to it and query it just like a warehouse, and "roll forward" your snapshot regularly. To get started, see [Create and manage a warehouse snapshot](../data-warehouse/create-manage-warehouse-snapshot.md). |
137
136
|**Warehouse source control (preview)**|Using [Source control with Warehouse (preview)](../data-warehouse/source-control.md), you can manage development and deployment of versioned warehouse objects. You can use [SQL Database Projects extension](/sql/azure-data-studio/extensions/sql-database-project-extension) available inside of [Azure Data Studio](/sql/azure-data-studio/download-azure-data-studio) and [Visual Studio Code](https://visualstudio.microsoft.com/downloads/). For more information on warehouse source control, see [CI/CD with Warehouses in Microsoft Fabric](https://blog.fabric.microsoft.com/blog/ci-cd-with-warehouses-in-microsoft-fabric/).|
138
137
|**Warehouse SQL Audit Logs**|[SQL Audit Logs](../data-warehouse/sql-audit-logs.md) in Fabric Data Warehouse provide a comprehensive and immutable record of all database activities, capturing critical details such as the event timestamp, the user or process that triggered the action, and the executed T-SQL statements. For more information, see [Introducing SQL Audit Logs for Fabric Data Warehouse](https://blog.fabric.microsoft.com/blog/introducing-sql-audit-logs-for-fabric-datawarehouse?ft=All).|
139
138
|**Workspace-level workload assignment (Preview)**|[Workspace admins can now add additional workloads directly to their workspaces](https://blog.fabric.microsoft.com/blog/new-in-microsoft-fabric-empowering-workspace-admins-with-direct-workload-assignment?ft=All), eliminating the need for tenant or capacity-level setup. In the [Workloads Hub](https://app.fabric.microsoft.com/workloadhub), admins can [add workloads directly to a workspace](../workload-development-kit/more-workloads-add.md).|
@@ -145,6 +144,7 @@ The following table lists the features of Microsoft Fabric that have recently tr
145
144
146
145
|**Month**|**Feature**|**Learn more**|
147
146
|:-- |:-- | :-- |
147
+
|November 2025|**Warehouse snapshots**|[Warehouse snapshots](https://blog.fabric.microsoft.com/blog/warehouse-snapshots-in-microsoft-fabric-freeze-data-unlock-reliable-reporting/), now generally available, are a point-in-time, read-only representation of your data warehouse. You can create a [snapshot of your warehouse](../data-warehouse/warehouse-snapshot.md) at any point in the past 30 days, connect to it and query it just like a warehouse, and "roll forward" your snapshot regularly. To get started, see [Create and manage a warehouse snapshot](../data-warehouse/create-manage-warehouse-snapshot.md). |
148
148
|November 2025|**ArcGIS GeoAnalytics for Microsoft Fabric Spark (Generally Available)**|[ArcGIS GeoAnalytics for Microsoft Fabric Spark (Generally Available)](https://blog.fabric.microsoft.com/blog/arcgis-geoanalytics-for-microsoft-fabric-spark-generally-available?ft=All), now generally available, brings spatial analytics to Fabric Spark. For more information, see [ArcGIS GeoAnalytics for Microsoft Fabric](../data-engineering/spark-arcgis-geoanalytics.md).|
149
149
|October 2025|**Query and ingest JSONL files (Generally Available)**|You can [query and ingest JSONL files in a warehouse or a SQL analytics endpoint](https://blog.fabric.microsoft.com/blog/query-and-ingest-jsonl-files-in-data-warehouse-and-sql-endpoint-for-lakehouse-general-availability?ft=All), now generally available. [OPENROWSET(BULK)](/sql/t-sql/functions/openrowset-bulk-transact-sql?view=fabric&preserve-view=true) enables scalable reading and ingestion of JSONL files. |
150
150
|October 2025|**Outbound Access Protection for Warehouse, SQL analytics endpoint**|[Outbound Access Protection (OAP)](https://blog.fabric.microsoft.com/blog/extending-outbound-access-protection-to-fabric-warehouse-and-sql-analytics-endpoint?ft=All) now applies to Fabric Warehouse (in Preview) and SQL analytics endpoint (GA) items, enforcing workspace-level rules for outbound connections. This strengthens governance, reduces risk, and ensures only trusted sources are used for data loads and queries. For more information, see [Workspace outbound access protection](../security/workspace-outbound-access-protection-overview.md).|
@@ -432,6 +432,7 @@ This section summarizes recent improvements and features for [Fabric Data Wareho
432
432
433
433
|**Month**|**Feature**|**Learn more**|
434
434
|:-- |:-- | :-- |
435
+
|November 2025|**Warehouse snapshots**|[Warehouse snapshots](https://blog.fabric.microsoft.com/blog/warehouse-snapshots-in-microsoft-fabric-freeze-data-unlock-reliable-reporting/), now generally available, are a point-in-time, read-only representation of your data warehouse. You can create a [snapshot of your warehouse](../data-warehouse/warehouse-snapshot.md) at any point in the past 30 days, connect to it and query it just like a warehouse, and "roll forward" your snapshot regularly. To get started, see [Create and manage a warehouse snapshot](../data-warehouse/create-manage-warehouse-snapshot.md). |
|October 2025|**SSMS 22 + Fabric Data Warehouse**|The new [SSMS 22 Preview adds improved Fabric Data Warehouse integration](https://blog.fabric.microsoft.com/blog/ssms-22-meets-fabric-data-warehouse-evolving-the-developer-experiences?ft=All) with workspace-based connection names, schema-based object grouping, warehouse snapshots support, and context-aware menus.|
437
438
|October 2025|**Query and ingest JSONL files (Generally Available)**|You can [query and ingest JSONL files in a warehouse or a SQL analytics endpoint](https://blog.fabric.microsoft.com/blog/query-and-ingest-jsonl-files-in-data-warehouse-and-sql-endpoint-for-lakehouse-general-availability?ft=All), now generally available. [OPENROWSET(BULK)](/sql/t-sql/functions/openrowset-bulk-transact-sql?view=fabric&preserve-view=true) enables scalable reading and ingestion of JSONL files. |
0 commit comments