Add Multi-Language Support for News Keywords and Outputs

[wahid18-maqs]

Currently, the project only supports single-language keyword detection and output generation. When users input keywords in multiple languages, the output remains static and does not adapt to the input language. This limits the project's accessibility for non-English-speaking users.

Describe the solution you'd like
I propose the following steps to add multi-language support:

1. Language Detection: Integrate a library like langdetect or langid to automatically identify the language of the input keywords.
2. Translation Mechanism: Use a lightweight and open-source translation tool (e.g., translate-python) to translate news content into the input language. This avoids reliance on paid services like Google Cloud or DeepL.
3. Prompt Adaptation: Modify the prompts to dynamically adjust based on the detected input language and ensure consistency in the output language.
4. Testing: Validate the feature by testing keywords and outputs across various languages to ensure accuracy and reliability.

Describe alternatives you've considered

1. Using Google Cloud or DeepL APIs for translations, but these options introduce additional costs.
2. Keeping the project limited to single-language support, which restricts usability.

Additional context
Adding multi-language support would make the project more inclusive and allow users from diverse linguistic backgrounds to benefit from its functionality. For example:

• Input Keywords: "लिनक्स" (Hindi)
• Expected Output: Relevant news articles about Linux in Hindi.

This feature aligns with the project's goal of making news retrieval accessible to a global audience.

[wahid18-maqs]

please assign @hardik1408

[hardik1408]

Hi @wahid18-maqs ,
Multi language support is not a priority for us as of right now

[innocentsoul333]

so is this a issue or not?

[hardik1408]

This can obviously be done, but is not a priority