BigQuery Usage Analysis

소개

This skill provides a comprehensive auditing tool for Google BigQuery environments, enabling developers and data engineers to gain visibility into query performance and project expenses. By querying project metadata via INFORMATION_SCHEMA, it identifies high-cost query patterns, tracks usage across specific service accounts, and detects common anti-patterns like inefficient SELECT statements or missing partitioning. It generates a prioritized report with actionable recommendations to help reduce GCP billing and improve overall data processing efficiency.

주요 기능

• Identification of heavy users and automated service accounts driving costs
• 29 GitHub stars
• Generation of structured Markdown reports with prioritized optimization fixes
• Automatic cost estimation using standard BigQuery on-demand pricing models
• Granular analysis of individual query patterns and execution frequency
• Detection of SQL anti-patterns such as 'SELECT *' and missing partitioning filters

사용 사례

• Identifying inefficient querying behavior across large team environments
• Debugging performance bottlenecks in automated data pipelines and dashboards
• Auditing monthly BigQuery spend to reduce cloud infrastructure costs