SEO 2024 queries #3791
Open
SEO 2024 queries #3791
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tunetheweb
changed the title
This was referenced Oct 30, 2024
tunetheweb
reviewed
Oct 30, 2024
| page, | ||
| getLoadingPropertyMarkupInfo(JSON_EXTRACT_SCALAR(payload, '$._markup')) AS loading_property_markup_info | ||
| FROM | ||
| `httparchive.all.pages` TABLESAMPLE SYSTEM (0.01 PERCENT) |
There was a problem hiding this comment.
This should be removed. Was the query run on the full dataset?
Suggested change
| `httparchive.all.pages` TABLESAMPLE SYSTEM (0.01 PERCENT) | |
| `httparchive.all.pages` |
| page AS site, | ||
| getRobotsSize(payload) AS robots_size | ||
| FROM | ||
| `httparchive.all.pages` TABLESAMPLE SYSTEM (0.01 PERCENT) |
There was a problem hiding this comment.
This should be removed. Was the query run on the full dataset?
Suggested change
| `httparchive.all.pages` TABLESAMPLE SYSTEM (0.01 PERCENT) | |
| `httparchive.all.pages` |
| header.value AS request_header_value, | ||
| COUNT(DISTINCT page) AS sites, | ||
| SUM(COUNT(DISTINCT page)) OVER (PARTITION BY client, is_root_page) AS total, | ||
| SAFE_DIVIDE(COUNT(0), SUM(COUNT(0)) OVER ()) AS pct |
| is_root_page, | ||
| REGEXP_CONTAINS(LOWER(IFNULL(request_headers[SAFE_OFFSET(0)].name, '')), r'user-agent') AS resp_vary_user_agent, | ||
| COUNT(0) AS freq, | ||
| SAFE_DIVIDE(COUNT(0), SUM(COUNT(0)) OVER ()) AS pct |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Makes progress on #3600
This PR adds the finalized SQL files which now include an is_root_page element that differentiates between the homepage and secondary pages. All SQL files utilize the June dataset, as it was the originating dataset used during the construction of these queries.
Context:
These changes were made to finalize the SQL queries for the 2024 SEO analysis. The new is_root_page element improves data separation between homepages and other pages, enhancing the overall analysis accuracy. Additionally, minor updates were applied to the SQL queries from 2022 to align with the new dataset structure. Common Table Expressions (CTEs) were introduced to improve efficiency and query readability.
Changes Made: