Websocket Disconnects

[CodingFu]

We are planning to use Conversational AI in production.

We have noticed that sometimes (1 time in 20) during the conversation, the socket closes and we see error like

I suppose it means 1 out of 2 things:

• your servers close websocket connection mid-conversation
• internet connection errors

1. is there a way to avoid or at least find out a reason for disconnection?
2. does the library attempts reconnecting if websocket connection was broken (i read connection.ts and did not find any reconnection logic)

[simonschmalfeld]

I'm having the same error every time when I use a prompt override while initializing the conversation. If I don't use the override, it works fine.

Error code:

await conversation.startSession({
  agentId: 'YOUR_AGENT_ID',
  overrides: {
    agent: {
      prompt: {
        prompt: "You are a helpful chatbot."
      }
    }
  }
})

Working code:

await conversation.startSession({
  agentId: 'YOUR_AGENT_ID',
  // overrides: {
  //   agent: {
  //     prompt: {
  //       prompt: 'You are a helpful chatbot.'
  //     }
  //   }
  // }
})

Also, message events seem to currently not be triggered in my code (but have worked before).

[simonschmalfeld]

Update: I noticed that both my issues mentioned above only happen with the Gemini 1.5 Flash model.

[CodingFu]

I forked their code and added websocket reconnects if websocket wasn't closed properly #22

[CodingFu]

@gmrchk @aarthificial @louisjoecodes @sedatcagdas @lacop11

Are you guys at 11labs hiring? I will be happy to join you as contractor part time so that my company can use 11labs conversatonal ai on production 😁

[oscar-horizonsarchitecture]

@gmrchk @aarthificial @louisjoecodes @sedatcagdas @lacop11 We need this update, because this problem breaks conversations with agents in production systems.