Cannot create spark pool in azure synapse analytics workspace

Hi Team, I am getting error while trying to create a spark pool in synapse workspace as per the constraints provided in azure data playground.

I used memory optimized, small size, 3 nodes with autoscale disabled but I am getting below error.

Error details

Notifications

DeploymentFailed At least one resource deployment operation failed. Please list deployment operations for details. Please see Deployment history - Azure Resource Manager | Microsoft Learn for usage details. Forbidden { “error”: { “code”: “RequestDisallowedByPolicy”, “target”: “synapse1001sp”, “message”: “Resource ‘synapse1001sp’ was disallowed by policy. Reasons: ‘Synapse big data pools must use MemoryOptimized node family, Small node size, maximum 3 nodes, and autoscaling must be disabled. Update configuration to comply.’. See error details for policy resource IDs.”, “additionalInfo”: [ { “type”: “PolicyViolation”, “info”: { “evaluationDetails”: { “evaluatedExpressions”: [ { “result”: “True”, “expressionKind”: “Field”, “expression”: “type”, “path”: “type”, “expressionValue”: “Microsoft.Synapse/workspaces/bigDataPools”, “targetValue”: “Microsoft.Synapse/workspaces/bigDataPools”, “operator”: “Equals” }, { “result”: “False”, “expressionKind”: “Field”, “expression”: “Microsoft.Synapse/workspaces/bigDataPools/autoScale.maxNodeCount”, “path”: “properties.autoScale.maxNodeCount”, “expressionValue”: 10, “targetValue”: 3, “operator”: “LessOrEquals” }, { “result”: “True”, “expressionKind”: “Field”, “expression”: “Microsoft.Synapse/workspaces/bigDataPools/autoScale.maxNodeCount”, “path”: “properties.autoScale.maxNodeCount”, “expressionValue”: 10, “targetValue”: “True”, “operator”: “Exists” } ], “reason”: “Synapse big data pools must use MemoryOptimized node family, Small node size, maximum 3 nodes, and autoscaling must be disabled. Update configuration to comply.” }, “policyDefinitionId”: “/subscriptions/a2b28c85-1948-4263-90ca-bade2bac4df4/providers/Microsoft.Authorization/policyDefinitions/7c36a021-62d4-4e44-943c-9a0e8b643977”, “policySetDefinitionId”: “/subscriptions/a2b28c85-1948-4263-90ca-bade2bac4df4/providers/Microsoft.Authorization/policySetDefinitions/ad300061e2a94b66b9c1cfb1”, “policyDefinitionReferenceId”: “synapse-big-data-pool-restrictions_1”, “policySetDefinitionName”: “ad300061e2a94b66b9c1cfb1”, “policySetDefinitionDisplayName”: “global_restrictions”, “policySetDefinitionVersion”: “1.0.0”, “policyDefinitionName”: “7c36a021-62d4-4e44-943c-9a0e8b643977”, “policyDefinitionDisplayName”: “synapse-big-data-pool-restrictions”, “policyDefinitionVersion”: “1.0.0”, “policyDefinitionEffect”: “deny”, “policyAssignmentId”: “/subscriptions/a2b28c85-1948-4263-90ca-bade2bac4df4/providers/Microsoft.Authorization/policyAssignments/ec65db1aab274a3ab6f3339d”, “policyAssignmentName”: “ec65db1aab274a3ab6f3339d”, “policyAssignmentDisplayName”: “global_restrictions”, “policyAssignmentScope”: “/subscriptions/a2b28c85-1948-4263-90ca-bade2bac4df4”, “policyAssignmentParameters”: {}, “policyExemptionIds”: [], “policyEnrollmentIds”: [] } } ] } }

I’m not sure what exactly you did, but the key part of the error is the part I show here. It does sound like you’re close to right, at least.

I’m unfamiliar with synapse, so if you can give a step-by-step for what you did to get to the error, that might be helpful. Then I can pass this on to one of our Azure experts if need be.

I am trying to create a spark pool in synapse workspace and used this values which is as per the playground rules. But due to some policy, I am not able to create spark pool.

Here is the restrictions given on website.

I’m still unable to replicate what you’re doing. I’ll pass this on to engineering, but a step-by-step would be helpful in doing that.

Hi rob,
I have able to create now.

I tried to create from within the synapse studio and it failed.

When I created from synapse workspace page, I have finally able to create.