Query DSL in Elasticsearch

Elasticsearch has become a cornerstone for businesses that rely on fast, scalable, and efficient search capabilities. At the heart of its power lies the Query DSL (Domain Specific Language), a flexible and robust framework for crafting search queries. Whether you're managing a small catalog or sifting through terabytes of data, mastering Query DSL can significantly enhance your search functionality. In this blog post, we’ll explore what Query DSL is, its structure, and how to build complex queries step-by-step.

What is Elasticsearch Query DSL?

Elasticsearch Query DSL is a JSON-based query language designed to help developers and analysts interact with Elasticsearch in a more natural and structured way. Unlike traditional SQL, Query DSL allows for complex nesting, filtering, and aggregations tailored for modern data structures.

With Query DSL, you can perform various tasks such as:

Retrieving documents that match specific conditions.
Aggregating and analyzing data in real-time.
Combining multiple queries to create nuanced search experiences.

Key Components of Query DSL

Before diving into query building, let’s break down the essential elements of Query DSL:

Match Queries: These are used for full-text search and are often the backbone of simple searches.
- Example: Find all documents where the "title" contains "Elasticsearch."
Bool Queries: Combine multiple queries using logical operators like must, should, must_not, and filter.
- Example: Retrieve documents where "status" is active but exclude those tagged as "archived."
Aggregations: Summarize your data by calculating metrics like averages, counts, or distributions.
- Example: Find the top 5 most popular products.
Filters: Narrow down your search without affecting scoring.
- Example: Only include results from the past 30 days.

Building Complex Queries Step-by-Step

Let’s construct a query to address a common scenario: searching an e-commerce dataset to find all products matching specific criteria, while sorting and filtering the results.

Step 1: Define the Basics with a Match Query

Start simple with a match query. For example, if we want to find products containing the keyword "laptop":

{
  "query": {
    "match": {
      "description": "laptop"
    }
  }
}

This will return all documents where the "description" field contains the term "laptop."

Step 2: Add Filters with a Bool Query

Suppose we only want laptops that are in stock and cost less than $1,000. We can use a bool query with a filter clause:

{
  "query": {
    "bool": {
      "must": {
        "match": {
          "description": "laptop"
        }
      },
      "filter": [
        { "term": { "in_stock": true } },
        { "range": { "price": { "lte": 1000 } } }
      ]
    }
  }
}

Here:

must ensures the term "laptop" is present.
filter applies additional constraints on in_stock and price.

Step 3: Include Sorting and Pagination

To improve the user experience, let’s sort the results by price in ascending order and return only the top 5 results:

{
  "query": {
    "bool": {
      "must": {
        "match": {
          "description": "laptop"
        }
      },
      "filter": [
        { "term": { "in_stock": true } },
        { "range": { "price": { "lte": 1000 } } }
      ]
    }
  },
  "sort": [
    { "price": { "order": "asc" } }
  ],
  "size": 5
}

This query ensures that users see the cheapest laptops first, limited to 5 results.

Step 4: Adding Aggregations for Insights

To enhance analytics, we might want to count the number of laptops by brand:

{
  "query": {
    "bool": {
      "must": {
        "match": {
          "description": "laptop"
        }
      },
      "filter": [
        { "term": { "in_stock": true } },
        { "range": { "price": { "lte": 1000 } } }
      ]
    }
  },
  "aggs": {
    "brand_counts": {
      "terms": {
        "field": "brand.keyword"
      }
    }
  }
}

The aggs block creates a bucket aggregation based on the "brand" field, helping identify popular brands within the filtered results.

Step 5: Combining Full-Text Search with Fuzzy Matching

What if a user searches for "lapto"? A fuzzy query can handle minor misspellings:

{
  "query": {
    "fuzzy": {
      "description": {
        "value": "lapto",
        "fuzziness": "AUTO"
      }
    }
  }
}

The fuzziness parameter allows Elasticsearch to intelligently interpret near matches.

Conclusion

Elasticsearch Query DSL is a powerful tool that transforms how you interact with data. By mastering its components, you can build highly customized queries tailored to specific use cases, from e-commerce search to real-time analytics. The examples in this guide are just the beginning—experiment with different query types, aggregations, and filters to unlock the full potential of Elasticsearch.

Query DSL in Elasticsearch

Mahedi Hasan Durjoy

What is Elasticsearch Query DSL?

Key Components of Query DSL

Building Complex Queries Step-by-Step

Conclusion

Related content