-
Notifications
You must be signed in to change notification settings - Fork 8
Backend Development: Database
On this page, we discuss our approach to using MongoDB as our cloud database and explain the rationale behind using it.
MongoDB Atlas offers several advantages over storing data locally, particularly when dealing with large and spontaneous data influxes. Here are some reasons why we opted for MongoDB Atlas:
One of the primary reasons for choosing MongoDB Atlas is its exceptional scalability. Unlike traditional local storage solutions, MongoDB Atlas allows our database to expand to accommodate increased data volumes and processing demands (Ermakov, 2023). This scalability ensures that our database can grow alongside our needs without compromising performance.
In addition to scalability, MongoDB Atlas also delivers high performance, even as the number of reviews continues to grow. Its architecture is optimised for handling large datasets efficiently, ensuring that our application remains responsive and reliable even under heavy load.
Our database schema is structured to efficiently manage the review data we collect. Here's an overview of our database collections and their respective remarks:
- app_ids/apps: Metadata used for scraping specific bank application reviews in the appstore.
- datetime: The datetime of the latest appstore review scraped. This is used to track unscraped reviews in preceding scraping processes.
- apps/token: Metadata used for scraping specific bank application reviews in the playstore.
- datetime: The datetime of the latest playstore review scraped. This is used to track unscraped reviews in preceding scraping processes.
- banks: List of banks that have application reviews scraped.
- responses: All the reviews that were collected and modelled.
- banks: List of banks that have reviews in the sample data.
- responses: Sample data utilised by Frontend while Backend was under development.
MongoDB Atlas provides the scalability and performance required to effectively manage our large and dynamic review data. Its cloud-based architecture ensures that our database can adapt to our evolving needs, making it the ideal choice for our storage solution.
Ermakov, D. (2024, April 3). Cloud-based vs Traditional databases: which one should you choose? WeAreBrain.