在 Elasticsearch 中使用 Amazon Nova 模型

作者：来自 Elastic Andre Luiz

了解如何在 Elasticsearch 中使用 Amazon Nova 系列模型。

在本文中，我们将讨论 Amazon 的 AI 模型家族——Amazon Nova，并学习如何将其与 Elasticsearch 结合使用。

关于 Amazon Nova

Amazon Nova 是 Amazon 的一系列人工智能模型，可在 Amazon Bedrock 上使用，旨在提供高性能和成本效益。这些模型支持文本、图像和视频输入，生成文本输出，并针对不同的准确性、速度和成本需求进行了优化。

Amazon Nova 主要模型

Amazon Nova Micro：专注于文本处理的快速、经济高效模型，适用于翻译、推理、代码补全和数学问题求解。其生成速度超过 200 个 token 每秒，非常适合需要即时响应的应用。
Amazon Nova Lite：一种低成本的多模态模型，可快速处理图像、视频和文本。其速度和准确性表现突出，适用于交互式和高数据量的应用，尤其是成本敏感的场景。
Amazon Nova Pro：最高级的选择，结合了高准确性、速度和成本效益。适用于视频摘要、问答、软件开发和 AI 代理等复杂任务。专家评测表明，它在文本和视觉理解方面表现卓越，并且能够遵循指令执行自动化工作流。

Amazon Nova 模型适用于多种应用场景，包括内容创作、数据分析、软件开发以及基于 AI 的流程自动化。

我们将展示如何将 Amazon Nova 模型与 Elasticsearch 结合使用，以实现自动化的产品评论分析。

我们将进行以下步骤：

通过 Inference API 创建一个端点，将 Amazon Bedrock 与 Elasticsearch 集成。
使用 Inference Processor 创建一个数据处理管道，该管道将调用 Inference API 端点。
索引产品评论，并使用管道自动生成评论分析。
分析集成后的结果。

在 Inference API 中创建端点

首先，我们配置 Inference API 以将 Amazon Bedrock 与 Elasticsearch 集成。我们选择 Amazon Nova Lite 作为使用的模型，其 ID 为 amazon.nova-lite-v1:0，因为它在速度、准确性和成本之间提供了良好的平衡。

注意：你需要有效的凭据才能使用 Amazon Bedrock。你可以在此处查看文档以获取访问密钥：

PUT _inference/completion/bedrock_completion_amazon_nova-lite
{
   "service": "amazonbedrock",
   "service_settings": {
       "access_key": "#access_key#",
       "secret_key": "#secret_key#",
       "region": "us-east-1",
       "provider": "amazontitan",
       "model": "amazon.nova-lite-v1:0"
   }
}

创建评论分析 pipeline

现在，我们创建一个处理流水线，该流水线将使用 Inference Processor 来执行评论分析提示（prompt）。该提示会将评论数据发送到 Amazon Nova Lite，并执行以下操作：

情感分类（正面、负面或中立）
评论摘要生成
关键词提取
真实性评估（真实 | 可疑 | 泛化）

PUT /_ingest/pipeline/review_analyzer_ai
{
      "processors": [
      {
        "script": 
            {
            "source": """ctx.prompt = "Analyze the following product review and return a structured JSON. Task: - Summarize the review concisely. - Detect and classify the sentiment as positive, neutral, or negative.- Generate relevant tags (keywords) based on the review content and detected sentiment. - Evaluate the authenticity of the review (authentic, suspicious, or generic). Review: " + ctx.review + " Respond in JSON format with the following fields: \"review_analyze\": {\"sentiment\": \"<positive | neutral | negative>\", \"authenticity\": \"<authentic | suspicious | generic>\",\"summary\": \"<short review summary>\", \"keywords\": [\"<keyword 1>\", \"<keyword 2>\", \"...\"]}}}"
            """
            }
      },
      {
        "inference": {
          "model_id": "bedrock_completion_amazon_nova-lite",
          "input_output": {
            "input_field": "prompt",
            "output_field": "result"
          }
        }
      },
      {
        "gsub": {
          "field": "result",
          "pattern": "```json",
          "replacement": ""
        } 
      },
      {
        "json" : {
          "field" : "result",
          "strict_json_parsing": false,
          "add_to_root" : true
        }
      },
      {
        "remove": {
          "field": "result"
        }
      },
      {
        "remove": {
          "field": "prompt"
        }
      }
    ]
}

索引评论

现在，我们使用 Bulk API 索引产品评论。之前创建的流水线将自动应用，并将 Nova 模型生成的分析结果添加到索引的文档中。

POST bulk/
{ "index": { "_index" : "products", "_id": 1, "pipeline":"review_analyzer_ai" } }
{ "product": "Pampers Pants Premium Care Fralda", "review": "Best diaper ever! Great material, lots of cotton, without all that plastic. Doesn't leak! My baby is a boy and every diaper leaked around the waist, this model solved the problem. Even on a small baby it's worth the effort of putting on the short diaper. I put it on my baby at 9 pm and only take it off in the morning, without any leaks." }
{ "index": { "_index" : "products", "_id": 2, "pipeline":"review_analyzer_ai" } }
{ "product": "Portable Electric Body Massager", "review": "It broke in three months for no apparent reason, thank goodness I didn't review it before. I don't recommend buying it because it has a short lifespan." }
{ "index": { "_index" : "products", "_id": 3, "pipeline":"review_analyzer_ai" } }
{ "product": "Havit Fuxi-H3 Black Quad-Mode Wired and Wireless Gaming Headset", "review": "The sound is good for the price, but the connectivity is horrible. You always need to be playing audio, otherwise it loses connection (I work from home, and this is very annoying). Sometimes it loses connection and you have to turn it off and on again to get it back on. The microphone is very sensitive, so it loses connection frequently and you have to turn the headset off and on for the microphone to work again. The flexibility of the stem is useless, because if you move it, the microphone can turn off. Sometimes I need to use Linux and the headset simply doesn't work. It's light and comfortable, the sound is adequate, but the connectivity is terrible." }
{ "index": { "_index" : "products", "_id": 4, "pipeline":"review_analyzer_ai" } }
{ "product": "Air Fryer 4L Oil Free Fryer Mondial", "review": "For those looking for value for money, it's a good option, but the tray (which is underneath the perforated basket) is already peeling a lot. My mother has one just like it and said that hers is even rusting, in other words, the material is MUCH inferior. There's also something that bothers me, because it looks like a microwave, it doesn't fry evenly, it's weaker in the middle and stronger on the sides. Buy at your own risk." }

查询和分析结果

最后，我们运行查询以查看 Amazon Nova Lite 模型如何分析和分类评论。通过执行 GET products/_search，我们可以获取已经被评论内容增强的文档。

该模型能够识别主要情感（正面、中立或负面），生成简要摘要，提取相关关键词，并评估每条评论的 真实性。这些字段有助于理解客户的意见，而无需阅读完整文本。

在解释结果时，我们关注以下方面：

情感：指示消费者对产品的整体感受。
摘要：提炼评论中提及的主要观点。
关键词：可用于分组相似评论或识别反馈模式。
真实性：判断评论是否可信，对内容审核或筛选有帮助。

   "hits": [
      {
        "_index": "products",
        "_id": "1",
        "_score": 1,
        "_ignored": [
          "review.keyword"
        ],
        "_source": {
          "product": "Pampers Pants Premium Care Fralda",
          "model_id": "bedrock_completion_amazon_nova-lite",
          "review_analyze": {
            "summary": "The reviewer praises the diaper for its great material, high cotton content, and leak-proof design, especially highlighting its effectiveness for their baby.",
            "sentiment": "positive",
            "keywords": [
              "best diaper",
              "great material",
              "cotton",
              "no plastic",
              "leak-proof",
              "baby",
              "effective"
            ],
            "authenticity": "authentic"
          },
          "review": "Best diaper ever! Great material, lots of cotton, without all that plastic. Doesn't leak! My baby is a boy and every diaper leaked around the waist, this model solved the problem. Even on a small baby it's worth the effort of putting on the short diaper. I put it on my baby at 9 pm and only take it off in the morning, without any leaks."
        }
      },
      {
        "_index": "products",
        "_id": "2",
        "_score": 1,
        "_source": {
          "product": "Portable Electric Body Massager",
          "model_id": "bedrock_completion_amazon_nova-lite",
          "review_analyze": {
            "summary": "The product broke in three months for no apparent reason and the reviewer does not recommend it due to its short lifespan.",
            "sentiment": "negative",
            "keywords": [
              "broke",
              "short lifespan",
              "not recommend"
            ],
            "authenticity": "authentic"
          },
          "review": "It broke in three months for no apparent reason, thank goodness I didn't review it before. I don't recommend buying it because it has a short lifespan."
        }
      },
      {
        "_index": "products",
        "_id": "3",
        "_score": 1,
        "_ignored": [
          "review.keyword"
        ],
        "_source": {
          "product": "Havit Fuxi-H3 Black Quad-Mode Wired and Wireless Gaming Headset",
          "model_id": "bedrock_completion_amazon_nova-lite",
          "review_analyze": {
            "summary": "The headset has good sound quality for the price but suffers from poor connectivity, especially when using the microphone or moving the headset. It also has compatibility issues with Linux.",
            "sentiment": "negative",
            "keywords": [
              "sound",
              "connectivity",
              "microphone",
              "compatibility",
              "annoying",
              "turn off and on",
              "Linux",
              "flexible stem",
              "work from home"
            ],
            "authenticity": "authentic"
          },
          "review": "The sound is good for the price, but the connectivity is horrible. You always need to be playing audio, otherwise it loses connection (I work from home, and this is very annoying). Sometimes it loses connection and you have to turn it off and on again to get it back on. The microphone is very sensitive, so it loses connection frequently and you have to turn the headset off and on for the microphone to work again. The flexibility of the stem is useless, because if you move it, the microphone can turn off. Sometimes I need to use Linux and the headset simply doesn't work. It's light and comfortable, the sound is adequate, but the connectivity is terrible."
        }
      },
      {
        "_index": "products",
        "_id": "4",
        "_score": 1,
        "_ignored": [
          "review.keyword"
        ],
        "_source": {
          "product": "Air Fryer 4L Oil Free Fryer Mondial",
          "model_id": "bedrock_completion_amazon_nova-lite",
          "review_analyze": {
            "summary": "The product offers value for money but has issues with peeling, rusting, and uneven frying.",
            "sentiment": "negative",
            "keywords": [
              "value for money",
              "peeling",
              "rusting",
              "uneven frying",
              "weaker in the middle"
            ],
            "authenticity": "authentic"
          },
          "review": "For those looking for value for money, it's a good option, but the tray (which is underneath the perforated basket) is already peeling a lot. My mother has one just like it and said that hers is even rusting, in other words, the material is MUCH inferior. There's also something that bothers me, because it looks like a microwave, it doesn't fry evenly, it's weaker in the middle and stronger on the sides. Buy at your own risk."
        }
      }
    ]