Package co.elastic.clients.elasticsearch.inference

Class GroqServiceSettings.Builder

java.lang.Object

co.elastic.clients.util.ObjectBuilderBase

co.elastic.clients.util.WithJsonObjectBuilderBase<GroqServiceSettings.Builder>

co.elastic.clients.elasticsearch.inference.GroqServiceSettings.Builder

All Implemented Interfaces:

WithJson<GroqServiceSettings.Builder>, ObjectBuilder<GroqServiceSettings>

Enclosing class:

GroqServiceSettings

public static class GroqServiceSettings.Builder
extends WithJsonObjectBuilderBase<GroqServiceSettings.Builder>
implements ObjectBuilder<GroqServiceSettings>

Builder for GroqServiceSettings.

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
final GroqServiceSettings.Builder	apiKey(String value)	A valid API key for accessing Groq API.
GroqServiceSettings	build()	Builds a GroqServiceSettings.
final GroqServiceSettings.Builder	modelId(String value)	Required - The name of the model to use for the inference task.
final GroqServiceSettings.Builder	rateLimit(RateLimitSetting value)	This setting helps to minimize the number of rate limit errors returned from the Groq API.
final GroqServiceSettings.Builder	rateLimit(Function<RateLimitSetting.Builder,ObjectBuilder<RateLimitSetting>> fn)	This setting helps to minimize the number of rate limit errors returned from the Groq API.
protected GroqServiceSettings.Builder	self()

Methods inherited from class co.elastic.clients.util.WithJsonObjectBuilderBase

withJson

Methods inherited from class co.elastic.clients.util.ObjectBuilderBase

_checkSingleUse, _listAdd, _listAddAll, _mapPut, _mapPutAll

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface co.elastic.clients.json.WithJson

withJson, withJson

Constructor Details

Builder

public Builder()

Method Details

modelId

public final GroqServiceSettings.Builder modelId(String value)

Required - The name of the model to use for the inference task. Refer to the Groq model documentation for the list of supported models and versions. Service has been tested and confirmed to be working for completion and chat_completion tasks with the following models:

• llama-3.3-70b-versatile

API name: model_id

apiKey

public final GroqServiceSettings.Builder apiKey(@Nullable
 String value)

A valid API key for accessing Groq API.

IMPORTANT: You need to provide the API key only once, during the inference model creation. The get inference endpoint API does not retrieve your API key.

API name: api_key

rateLimit

public final GroqServiceSettings.Builder rateLimit(@Nullable
 RateLimitSetting value)

This setting helps to minimize the number of rate limit errors returned from the Groq API. By default, the groq service sets the number of requests allowed per minute to 1000. Refer to Groq documentation for more details.

API name: rate_limit

rateLimit

public final GroqServiceSettings.Builder rateLimit(Function<RateLimitSetting.Builder,ObjectBuilder<RateLimitSetting>> fn)

This setting helps to minimize the number of rate limit errors returned from the Groq API. By default, the groq service sets the number of requests allowed per minute to 1000. Refer to Groq documentation for more details.

API name: rate_limit

self

protected GroqServiceSettings.Builder self()

Specified by:

self in class WithJsonObjectBuilderBase<GroqServiceSettings.Builder>

build

public GroqServiceSettings build()

Builds a GroqServiceSettings.

Specified by:

build in interface ObjectBuilder<GroqServiceSettings>

Throws:

NullPointerException - if some of the required fields are null.