Can it assist with cluster security and networking?

Yes, it covers VNet security, NSG rules, Private Link, Entra ID integration, and Apache Ranger policies for secure cluster management.

Can this skill help with Azure Databricks or Synapse?

No, this skill is specifically focused on Azure HDInsight. For Databricks or Synapse, you should use the azure-databricks or azure-synapse-analytics skills respectively.

Does this skill require an internet connection?

Yes, it requires network access to fetch the latest documentation and troubleshooting guides from Microsoft Learn via MCP or WebFetch.

What HDInsight components are supported?

It provides expert knowledge for Apache Spark, Hive, Kafka, HBase, Hadoop, YARN, and Ambari within the HDInsight ecosystem.

How does it handle troubleshooting?

The skill analyzes error codes and symptoms, then references specific diagnostic steps for issues like disk space exhaustion, authentication failures, and service timeouts.

Azure HDInsight Expert

Name: Azure HDInsight Expert
Author: atc-net

byatc-net

•

云基础设施

Provides expert guidance for developing, deploying, and troubleshooting big data clusters on Azure HDInsight including Spark, Hive, and Kafka.

This skill equips Claude with deep technical knowledge for managing Azure HDInsight environments, covering Hadoop, Spark, Hive, Kafka, and HBase. It assists developers and architects with troubleshooting cluster failures, implementing security best practices via Entra ID and VNets, and optimizing performance for large-scale data processing. Whether you are migrating on-premises workloads or configuring autoscale and high availability, this skill provides actionable patterns and direct access to official documentation to accelerate cloud-based big data development.

主要功能

01Architecture design patterns for high availability, disaster recovery, and migration

02Performance tuning and best practices for Spark, Hive, Kafka, and HBase workloads

03Comprehensive troubleshooting for cluster creation, networking, and service-level errors

041 GitHub stars

05Deployment automation support via ARM templates, CLI, and PowerShell

06Security configuration guidance for Entra ID, Apache Ranger, and Private Link

使用场景

01Designing and implementing a secure, VNet-isolated HDInsight cluster for enterprise data

02Diagnosing and resolving Ambari, YARN, or HDFS service failures in a production cluster

03Migrating legacy on-premises Hadoop workloads to a managed Azure HDInsight environment

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add atc-net/atc-agentic-toolkit azure-hdinsight

For use in Claude.ai and ChatGPT

主要功能

01Architecture design patterns for high availability, disaster recovery, and migration

02Performance tuning and best practices for Spark, Hive, Kafka, and HBase workloads

03Comprehensive troubleshooting for cluster creation, networking, and service-level errors

041 GitHub stars

05Deployment automation support via ARM templates, CLI, and PowerShell

06Security configuration guidance for Entra ID, Apache Ranger, and Private Link

使用场景

01Designing and implementing a secure, VNet-isolated HDInsight cluster for enterprise data

02Diagnosing and resolving Ambari, YARN, or HDFS service failures in a production cluster

03Migrating legacy on-premises Hadoop workloads to a managed Azure HDInsight environment