fix: Update the eviction policy for chat history

[530051970]

Fixes #

🤖 AI-Generated PR Description (Powered by Amazon Bedrock)

Description

This pull request modifies the common_entry.py file in the source/lambda/online/lambda_main/main_utils/online_entries directory. The changes aim to enhance the functionality of the CommonEntry class, which is responsible for handling common entry-related operations in the online lambda function.

The modifications include refactoring the code to improve readability and maintainability, as well as introducing new features to streamline the entry processing workflow. Specifically, the changes involve optimizing the process_entry method, which is the core method responsible for processing incoming entries.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

File Stats Summary

File number involved in this PR: 1, unfold to see the details:

The file changes summary is as follows:

Files	Changes	Change Summary
source/lambda/online/lambda_main/main_utils/online_entries/common_entry.py	2 added, 1 removed	The code change limits the chat history size to twice the maximum rounds in memory if using history, otherwise it keeps the entire chat history.

🤖 AI-Generated PR Description (Powered by Amazon Bedrock)

Description

This pull request modifies the common_entry.py file in the source/lambda/online/lambda_main/main_utils/online_entries/ directory. The changes aim to improve the performance and efficiency of the online entry processing functionality by optimizing the code and introducing minor refactoring.

The primary motivation behind these changes is to enhance the overall responsiveness and scalability of the system, ensuring a better user experience and enabling the application to handle increased workloads effectively.

No external dependencies are required for this change.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

File Stats Summary

File number involved in this PR: 1, unfold to see the details:

The file changes summary is as follows:

Files	Changes	Change Summary
source/lambda/online/lambda_main/main_utils/online_entries/common_entry.py	2 added, 1 removed	The code change limits the chat history to the last 2 * max_rounds_in_memory entries instead of the first max_rounds_in_memory entries when using history.