Package com.pnfsoftware.jeb.client.mcp.llm

Class BedrockConversation

java.lang.Object

com.pnfsoftware.jeb.client.mcp.llm.BedrockConversation

All Implemented Interfaces:

ILlmConversation

public class BedrockConversation
extends Object

Field Summary

Fields

Modifier and Type	Field	Description
protected List<Object>	aggrMessages
protected long	aggrRespTimeMs
protected okhttp3.OkHttpClient	httpClient	initialized by the builder
protected String	lastStopReason
protected int	lastTokensIn	last request's count of input tokens (including cache-hits!)
protected int	lastTokensInCacheHit	last request's count of input tokens that came from the cache
protected int	lastTokensOut	last request's count of output tokens, including cache-hits
protected LlmSettings	settings	initialized by the builder
protected int	totalTokensIn
protected int	totalTokensInCacheHit
protected int	totalTokensOut

Constructor Summary

Constructors

Constructor	Description
BedrockConversation()

Method Summary

Modifier and Type	Method	Description
protected void	addCustomHeaders(okhttp3.Request.Builder reqbld)
void	clearMessages()
void	close()
LlmConversationBuilder.Information	getInformation()
List<Object>	getMessages()
List<String>	listModels()
protected String	resolveApiKey()
List<LlmConversationBuilder.Content>	send(String prompt)
List<LlmConversationBuilder.Content>	send(List<LlmConversationBuilder.Content> contentList)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

settings

protected LlmSettings settings

initialized by the builder

httpClient

protected okhttp3.OkHttpClient httpClient

initialized by the builder

totalTokensInCacheHit

protected int totalTokensInCacheHit

totalTokensIn

protected int totalTokensIn

totalTokensOut

protected int totalTokensOut

lastTokensInCacheHit

protected int lastTokensInCacheHit

last request's count of input tokens that came from the cache

lastTokensIn

protected int lastTokensIn

last request's count of input tokens (including cache-hits!)

lastTokensOut

protected int lastTokensOut

last request's count of output tokens, including cache-hits

lastStopReason

protected String lastStopReason

aggrRespTimeMs

protected long aggrRespTimeMs

aggrMessages

protected List<Object> aggrMessages

Constructor Details

BedrockConversation

public BedrockConversation()

Method Details

listModels

public List<String> listModels()
                        throws Exception

Throws:

Exception

send

public List<LlmConversationBuilder.Content> send(List<LlmConversationBuilder.Content> contentList)
                                          throws Exception

Throws:

Exception

close

public void close()

Specified by:

close in interface ILlmConversation

addCustomHeaders

protected void addCustomHeaders(okhttp3.Request.Builder reqbld)

resolveApiKey

protected String resolveApiKey()

getInformation

public LlmConversationBuilder.Information getInformation()

Specified by:

getInformation in interface ILlmConversation

send

public List<LlmConversationBuilder.Content> send(String prompt)
                                          throws Exception

Specified by:

send in interface ILlmConversation

Throws:

Exception

getMessages

public List<Object> getMessages()

Specified by:

getMessages in interface ILlmConversation

clearMessages

public void clearMessages()

Specified by:

clearMessages in interface ILlmConversation