Merge branch 'main' into jinja2-set-vars-incorrect

Author: srini047

docs-website/docs/concepts/components_overview.mdx renamed to docs-website/docs/concepts/components-overview.mdx

@@ -30,7 +30,7 @@ Read more about various Generators in our [guides](../pipeline-components/genera
 
 [Retrievers](../pipeline-components/retrievers.mdx) go through all the documents in a Document Store, select the ones that match the user query, and pass it on to the next component. There are various Retrievers that are customized for specific Document Stores. This means that they can handle specific requirements for each database using customized parameters.
 
-For example, for Elasticsearch Document Store, you will find both the Document Store and Retriever packages in its GitHub [repo](https://github.com/deepset-ai/haystack-core-integrations/tree/main/integrations/elasticsearch). 
+For example, for Elasticsearch Document Store, you will find both the Document Store and Retriever packages in its GitHub [repo](https://github.com/deepset-ai/haystack-core-integrations/tree/main/integrations/elasticsearch).
 
 ### Document Stores
 
@@ -42,9 +42,9 @@ If you are working with more complex pipelines in Haystack, you can use a [`Docu
 
 You can use different [data classes](data-classes.mdx) in Haystack to carry the data through the system. The data classes are mostly likely to appear as inputs or outputs of your pipelines.
 
-`Document` class contains information to be carried through the pipeline. It can be text, metadata, tables, or binary data. Documents can be written into Document Stores but also written and read by other components.  
+`Document` class contains information to be carried through the pipeline. It can be text, metadata, tables, or binary data. Documents can be written into Document Stores but also written and read by other components.
 
-`Answer` class holds not only the answer generated in a pipeline but also the originating query and metadata. 
+`Answer` class holds not only the answer generated in a pipeline but also the originating query and metadata.
 
 ### Pipelines
 
@@ -53,4 +53,4 @@ Finally, you can combine various components, Document Stores, and integrations i
 If you want to reuse pipelines, you can save them into a convenient format (YAML, TOML, and more) on a disk or share them around using the [serialization](pipelines/serialization.mdx) process.
 
 Here is a short Haystack pipeline, illustrated:
-<ClickableImage src="/img/00f5fe8-Pipeline_Illustrations_2.png" alt="" />
+<ClickableImage src="/img/00f5fe8-Pipeline_Illustrations_2.png" alt="" />

docs-website/docs/concepts/concepts-overview.mdx

@@ -1,6 +1,6 @@
 ---
 title: "Haystack Concepts Overview"
-id: "concepts-overview"
+id: concepts-overview
 description: "Haystack provides all the tools you need to build custom agents and RAG pipelines with LLMs that work for you. This includes everything from prototyping to deployment. This page discusses the most important concepts Haystack operates on."
 ---
 
@@ -51,4 +51,4 @@ If you want to reuse pipelines, you can save them into a convenient format (YAML
 
 Here is a short Haystack pipeline, illustrated:
 
-![Short Haystack pipeline](/img/pipeline-illustration-overview.png)
+![Short Haystack pipeline](/img/pipeline-illustration-overview.png)

docs-website/docs/overview/intro.mdx renamed to docs-website/docs/intro.mdx

@@ -1,7 +1,6 @@
 ---
 title: "Introduction to Haystack"
 id: intro
-slug: "/intro"
 description: "Haystack is an **open-source AI framework** for building production-ready **AI Agents**,  **retrieval-augmented generative pipelines** and **state-of-the-art multimodal search systems**. Learn more about Haystack and how it works."
 ---
 
@@ -12,7 +11,7 @@ Haystack is an **open-source AI framework** for building production-ready **AI A
 :::tip
 Welcome to Haystack
 
-To skip the introductions and go directly to installing and creating a search app, see  [Get Started](get_started.mdx).
+To skip the introductions and go directly to installing and creating a search app, see  [Get Started](overview/get-started.mdx).
 :::
 
 Haystack is an open-source AI orchestration framework that you can use to build powerful, production-ready applications with Large Language Models (LLMs) for various use cases. Whether you’re creating autonomous agents, multimodal apps, or scalable RAG systems, Haystack provides the tools to move from idea to production easily.
@@ -31,4 +30,4 @@ If your team needs **enterprise-grade support, best practices, and deployment gu
 📜 [Learn more about Haystack Enterprise](https://haystack.deepset.ai/blog/announcing-haystack-enterprise)
 
 👉 [Get in touch with our team](https://www.deepset.ai/products-and-services/haystack-enterprise)
-:::
+:::

docs-website/docs/overview/get_started.mdx renamed to docs-website/docs/overview/get-started.mdx

@@ -102,4 +102,4 @@ RECIPE MISSING
 
 ### Adding Your Data
 
-Instead of running the RAG pipeline on example data, learn how you can add your own custom data using [Document Stores](../concepts/document-store.mdx).
+Instead of running the RAG pipeline on example data, learn how you can add your own custom data using [Document Stores](../concepts/document-store.mdx).

docs-website/docs/overview/migration.mdx

@@ -9,7 +9,7 @@ description: "Learn how to make the move to Haystack 2.x from Haystack 1.x."
 
 Learn how to make the move to Haystack 2.x from Haystack 1.x.
 
-This guide is designed for those with previous experience with Haystack and who are interested in understanding the differences between Haystack 1.x and Haystack 2.x. If you're new to Haystack, skip this page and proceed directly to Haystack 2.x [documentation](get_started.mdx).
+This guide is designed for those with previous experience with Haystack and who are interested in understanding the differences between Haystack 1.x and Haystack 2.x. If you're new to Haystack, skip this page and proceed directly to Haystack 2.x [documentation](get-started.mdx).
 
 ## Major Changes
 
@@ -38,11 +38,11 @@ While Haystack 2.x continues to rely on the `Pipeline` abstraction, the elements
 
 Pipelines continue to serve as the fundamental structure of all Haystack applications. While the concept of `Pipeline` abstraction remains consistent, Haystack 2.x introduces significant enhancements that address various limitations of its predecessor. For instance, the pipelines now support loops. Pipelines also offer greater flexibility in their input, which is no longer restricted to queries. The pipeline now allows to route the output of a component to multiple recipients. This increases flexibility, however, comes with notable differences in the pipeline definition process in Haystack 2.x compared to the previous version.
 
-In Haystack 1.x, a pipeline was built by adding one node after the other. In the resulting pipeline graph, edges are automatically added to connect those nodes in the order they were added. 
+In Haystack 1.x, a pipeline was built by adding one node after the other. In the resulting pipeline graph, edges are automatically added to connect those nodes in the order they were added.
 
 Building a pipeline in Haystack 2.x is a two-step process:
 
-1. Initially, components are added to the pipeline without any specific order by calling the `add_component` method. 
+1. Initially, components are added to the pipeline without any specific order by calling the `add_component` method.
 2. Subsequently, the components must be explicitly connected by calling the `connect` method to define the final graph.
 
 To migrate an existing pipeline, the first step is to go through the nodes and identify their counterparts in Haystack 2.x (see the following section,  [_Migrating Components_](#migrating-components), for guidance). If all the nodes can be replaced by corresponding components, they have to be added to the pipeline with `add_component` and explicitly connected with the appropriate calls to `connect`. Here is an example:
@@ -121,7 +121,7 @@ The [_Migration examples_](#migration-examples) section below shows how to port
 
 The agentic approach facilitates the answering of questions that are significantly more complex than those typically addressed by extractive or generative question answering techniques.
 
-Haystack 1.x provided Agents, enabling the use of LLMs in a loop. 
+Haystack 1.x provided Agents, enabling the use of LLMs in a loop.
 
 Currently in Haystack 2.x, you can build Agents using three main elements in a pipeline: Chat Generators, ToolInvoker component, and Tools. A standalone Agent abstraction in Haystack 2.x is in an experimental phase.
 
@@ -297,11 +297,11 @@ cleaner = DocumentCleaner(
     remove_extra_whitespaces=True,
 )
 indexing_pipeline.add_component("cleaner", cleaner)
- 
+
 ## Pre-processes the text by performing splits and adding metadata to the text (DocumentSplitter component)
 preprocessor = DocumentSplitter(
-    split_by="passage", 
-    split_length=100, 
+    split_by="passage",
+    split_length=100,
     split_overlap=50
 )
 indexing_pipeline.add_component("preprocessor", preprocessor)
@@ -348,9 +348,9 @@ extractive_qa_pipeline = ExtractiveQAPipeline(reader, retriever)
 
 query = "What is the capital of France?"
 result = extractive_qa_pipeline.run(
-	query=query, 
+	query=query,
 	params={
-		"Retriever": {"top_k": 10}, 
+		"Retriever": {"top_k": 10},
 		"Reader": {"top_k": 5}
 	}
 )
@@ -385,7 +385,7 @@ extractive_qa_pipeline.connect("retriever", "reader")
 
 query = "What is the capital of France?"
 result = extractive_qa_pipeline.run(data={
-	"retriever": {"query": query, "top_k": 3}, 
+	"retriever": {"query": query, "top_k": 3},
 	"reader": {"query": query, "top_k": 2}
 })
 ```
@@ -491,4 +491,4 @@ You can access old tutorials in the [GitHub history](https://github.com/deepset-
 
 The ZIP file contains documentation for all minor releases from version 1.0 to 1.26.
 
-To download documentation for a specific release, replace the version number in the following URL: `https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/v1.26.zip`.
+To download documentation for a specific release, replace the version number in the following URL: `https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/v1.26.zip`.

docs-website/docs/pipeline-components/converters.mdx

@@ -20,6 +20,7 @@ Use various Converters to extract data from files in different formats and cast
 | [ImageFileToImageContent](converters/imagefiletoimagecontent.mdx)       | Reads local image files and converts them into `ImageContent` objects.                                        |
 | [JSONConverter](converters/jsonconverter.mdx)                           | Converts JSON files to text documents.                                                                        |
 | [MarkdownToDocument](converters/markdowntodocument.mdx)               | Converts markdown files to documents.                                                                         |
+| [MistralOCRDocumentConverter](converters/mistralocrdocumentconverter.mdx) | Extracts text from documents using Mistral's OCR API, with optional structured annotations.                   |
 | [MSGToDocument](converters/msgtodocument.mdx)                           | Converts Microsoft Outlook .msg files to documents.                                                           |
 | [MultiFileConverter](converters/multifileconverter.mdx)                 | Converts CSV, DOCX, HTML, JSON, MD, PPTX, PDF, TXT, and XSLX files to documents.                              |
 | [OpenAPIServiceToFunctions](converters/openapiservicetofunctions.mdx) | Transforms OpenAPI service specifications into a format compatible with OpenAI's function calling mechanism.  |
@@ -31,4 +32,4 @@ Use various Converters to extract data from files in different formats and cast
 | [TikaDocumentConverter](converters/tikadocumentconverter.mdx)         | Converts various file types to documents using Apache Tika.                                                   |
 | [TextFileToDocument](converters/textfiletodocument.mdx)               | Converts text files to documents.                                                                             |
 | [UnstructuredFileConverter](converters/unstructuredfileconverter.mdx) | Converts text files and directories to a document.                                                            |
-| [XLSXToDocument](converters/xlsxtodocument.mdx)                         | Converts Excel files into documents.                                                                          |
+| [XLSXToDocument](converters/xlsxtodocument.mdx)                         | Converts Excel files into documents.                                                                          |