Unable to mount datastore (Getting error with dependency)

[ajaymaity]

Describe the bug

I am trying to mount a datastore to my system (linux), but I get the following error:

I installed the package azureml-dataprep-rslex based on the suggestion, but still getting the same error:

I tried on a fresh compute instance, but still have the same error there. Could anyone help?

Related command

az ml datastore mount

Errors

This command is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
The command failed with an unexpected error. Here is the traceback:
Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex
Traceback (most recent call last):
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 666, in execute
raise ex
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 733, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 703, in _run_job
result = cmd_copy(params)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 336, in call
return self.handler(*args, **kwargs)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/datastore.py", line 104, in ml_datastore_mount
modify_sys_path_for_rslex_mount(persistent)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/utils.py", line 463, in modify_sys_path_for_rslex_mount
raise Exception(
Exception: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex

Issue script & Debug output

Output with --debug enabled:

cli.knack.cli: Command arguments: ['ml', 'datastore', 'mount', '--mount-point', '/mnt/tfmlexpamaityst0113_demo_data', '--mode', 'ro_mount', '--path', 'tfmlexpamaityst0113_demo_data', '--debug']
cli.knack.cli: init debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x7efe0abd9000>, <function OutputProducer.on_global_arguments at 0x7efe0a9353f0>, <function CLIQuery.on_global_arguments at 0x7efe0a95a680>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'ml': ['azext_mlv2']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name Load Time Groups Commands
cli.azure.cli.core: Total (0) 0.000 0 0
cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_ai_examples', 'azext_next']
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name Load Time Groups Commands Directory
azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
azext_mlv2.manual.vendored_curated_sdk.azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
cli.azure.cli.core: ml 2.561 24 161 /opt/az/extensions/ml
cli.azure.cli.core: Total (1) 2.561 24 161
cli.azure.cli.core: Loaded 24 groups, 161 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command : ml datastore mount
cli.azure.cli.core: Command table: ml datastore mount
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x7efe09c5b2e0>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to '/home/azureuser/.azure/commands/2025-01-08.15-02-10.ml_datastore_mount.8666.log'.
az_command_data_logger: command args: ml datastore mount --mount-point {} --mode {} --path {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument..add_subscription_parameter at 0x7efe09c94280>]
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument..add_ids_arguments at 0x7efe09cb6290>, <function register_cache_arguments..add_cache_arguments at 0x7efe09cb63b0>, <function register_upcoming_breaking_change_info..update_breaking_change_info at 0x7efe09cb6440>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x7efe0a935480>, <function CLIQuery.handle_query_parameter at 0x7efe0a95a710>, <function register_ids_argument..parse_ids_arguments at 0x7efe09cb6320>]
az_command_data_logger: extension name: ml
az_command_data_logger: extension version: 2.33.1
This command is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=AzureMachineLearningWorkspaces
cli.azure.cli.core.auth.persistence: build_persistence: location='/home/azureuser/.azure/msal_token_cache.json', encrypt=False
cli.azure.cli.core.auth.binary_cache: load: /home/azureuser/.azure/msal_http_cache.bin
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: Initializing with Entra authority: https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898
msal.authority: openid_config("https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/v2.0/.well-known/openid-configuration") = {'token_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/kerberos', 'tenant_region_scope': 'EU', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? None
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=_ml_client_cli
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: Initializing with Entra authority: https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898
msal.authority: openid_config("https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/v2.0/.well-known/openid-configuration") = {'token_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/4308d118-edd1-4300-8a37-cfeba8ad5898/kerberos', 'tenant_region_scope': 'EU', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? None
cli.azure.cli.core.azclierror: Traceback (most recent call last):
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 666, in execute
raise ex
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 733, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 703, in _run_job
result = cmd_copy(params)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 336, in call
return self.handler(*args, **kwargs)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/datastore.py", line 104, in ml_datastore_mount
modify_sys_path_for_rslex_mount(persistent)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/utils.py", line 463, in modify_sys_path_for_rslex_mount
raise Exception(
Exception: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex

cli.azure.cli.core.azclierror: The command failed with an unexpected error. Here is the traceback:
az_command_data_logger: The command failed with an unexpected error. Here is the traceback:
cli.azure.cli.core.azclierror: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex
Traceback (most recent call last):
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 666, in execute
raise ex
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 733, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 703, in _run_job
result = cmd_copy(params)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 336, in call
return self.handler(*args, **kwargs)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/datastore.py", line 104, in ml_datastore_mount
modify_sys_path_for_rslex_mount(persistent)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/utils.py", line 463, in modify_sys_path_for_rslex_mount
raise Exception(
Exception: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex
az_command_data_logger: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex
Traceback (most recent call last):
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 666, in execute
raise ex
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 733, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 703, in _run_job
result = cmd_copy(params)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/init.py", line 336, in call
return self.handler(*args, **kwargs)
File "/anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/datastore.py", line 104, in ml_datastore_mount
modify_sys_path_for_rslex_mount(persistent)
File "/opt/az/extensions/ml/azext_mlv2/manual/custom/utils.py", line 463, in modify_sys_path_for_rslex_mount
raise Exception(
Exception: Cannot mount since azureml-dataprep-rslex is not installed. It is required for az ml data mount and az ml data mount to work.To install, run: $ pip install --target $(az extension show -n ml --query path) azureml-dataprep-rslex
To check existing issues, please visit: https://github.com/Azure/azure-cli/issues
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x7efe09c5b520>]
az_command_data_logger: exit code: 1
cli.main: Command ran in 2.947 seconds (init: 0.134, invoke: 2.812)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 8067 in cache
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "/anaconda/envs/azureml_py38/bin/python /anaconda/envs/azureml_py38/lib/python3.10/site-packages/azure/cli/telemetry/init.py /home/azureuser/.azure"
telemetry.process: Return from creating process
telemetry.main: Finish creating telemetry upload process.

Expected behavior

The data mount command should not return an error.

Environment Summary

azure-cli 2.64.0 *

core 2.64.0 *
telemetry 1.1.0

Extensions:
ml 2.33.1

Dependencies:
msal 1.30.0
azure-mgmt-resource 23.1.1

Python location '/anaconda/envs/azureml_py38/bin/python'
Extensions directory '/opt/az/extensions'

Python (Linux) 3.10.11 | packaged by conda-forge | (main, May 10 2023, 18:58:44) [GCC 11.3.0]

Legal docs and information: aka.ms/AzureCliLegal

You have 2 update(s) available. Consider updating your CLI installation with 'az upgrade'

Additional context

No response

[yonzhan]

Thank you for opening this issue, we will look into it.

[manuelkonrad]

@ajaymaity @yonzhan I ran into the same issue today. I managed to solve it by installing azureml-dataprep instead of just azureml-dataprep-rslex. It is important to run the installation with --upgrade, since there is an empty azureml.dataprep package in the ml extension directory. On a Compute Instance:

pip install --target /opt/az/extensions/ml azureml-dataprep --upgrade

Furthermore, I had to run the mount command in a conda environment where the pip packages azure-cli and azure-ai-ml are installed.