Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 GPT Quiz | Servers need more capacity/redundancy #1175

Open
2 of 6 tasks
jernejk opened this issue Jan 28, 2025 · 1 comment
Open
2 of 6 tasks

🐛 GPT Quiz | Servers need more capacity/redundancy #1175

jernejk opened this issue Jan 28, 2025 · 1 comment
Assignees
Labels
bug An issue with the system 🐛.

Comments

@jernejk
Copy link
Member

jernejk commented Jan 28, 2025

Cc: @chrisschultzssw

Hi @adamcogan,

Describe the Bug

Yesterday, we had an incident where GPT Quiz server went offline. While we are still diagnosing the root cause, it was likely because we are using shared resources and we ran out of them which resulted in WebApp not starting up when @chrisschultzssw updated the DevOps pipeline so that we can make new deployments.

There were no errors, no logs, no messages indicating what's happening but luckily, I've seen this before and I knew the issue might not be with the app. @chrisschultzssw updated the App Service Plan and it started to work.

Expected Behavior

The Azure Web App should always work.

Tasks

  • Make Azure Web App work for NDC London
  • Investigate
  • Long-term fix

Acceptance Criteria

More Information

Environment

  • Device: [e.g. iPhone 12]
  • OS: [e.g. iOS]

Screenshots

Image
Figure: Server was unresponsive, likely due to not running.

Image
Figure: We have consistent 404 on / endpoint which allowed us to pin point rough time server went offline.

Thanks!

@jernejk jernejk added the bug An issue with the system 🐛. label Jan 28, 2025
@jernejk
Copy link
Member Author

jernejk commented Jan 28, 2025

The server is back online around 7:30 pm Sydney time/8:30 am London time

Image
Figure: The server started to respond around 7:20 pm and at around 7:30 pm I confirmed it was working correctly.

@sethdaily sethdaily changed the title 🐛 GPT Quiz | Servers down 🐛 GPT Quiz | Servers need more capacity/redundancy Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug An issue with the system 🐛.
Projects
None yet
Development

No branches or pull requests

2 participants