LCM Operation failed. Reason: Inventory setup failed. Reason: [Failed to get size of file at https://download.nutanix.com/lcm/2.0/master_manifest.tgz.sign]

LCM Operation failed. Reason: Inventory setup failed. Reason: [Failed to get size of file at https://download.nutanix.com/lcm/2.0/master_manifest.tgz.sign]

Sometimes LCM failed due to an incorrect manifest file triggering below errors

LCM OPERATION FAILED
LCM OPERATION FAILED

In Prism element task you may have errors like :-

Error 1

“Lcmroottask failed: Operation failed. Reason: Task 9820jsbhkd092008jslsbdh920 did not succeed”

Error 2

Operation failed. Reason: Failed while downloading LCM Module ‘nutanix.tools’ from ‘http://download.nutanix.com/lcm/2.0/module/nutanix.tools’ with error ‘NdfsDownloaderUploadError: Could not access the URL: The requested URL returned error: 403 Forbidden’

Open the SSH connection to LCM leader :-

2020-09-07 21:06:01 ERROR catalog_utils.py:307 Task 9820jsbhkd092008jslsbdh920 did not succeed
2020-09-07 21:06:01 ERROR exception.py:54 LCM Exception [LcmDownloaderError]: Task 9820jsbhkd092008jslsbdh920 did not succeed
Traceback (most recent call last):
File "/home/ubuntu/lcm-framework/build/python-tree/bdist.linux-x86_64/egg/framework/main/exception.py", line 229, in wrapper
File "/home/ubuntu/lcm-framework/build/python-tree/bdist.linux-x86_64/egg/framework/main/framework.py", line 563, in __run_operations
File "/home/ubuntu/lcm-framework/build/python-tree/bdist.linux-x86_64/egg/framework/main/base_classes/base_op.py", line 112, in setup
File "/home/ubuntu/lcm-framework/build/python-tree/bdist.linux-x86_64/egg/framework/main/downloader/download_manager.py", line 98, in get_manifest_file
LcmDownloaderError: Task 9820jsbhkd092008jslsbdh920 did not succeed

In catlog.out log file you will see below error :-

2020-09-07 21:06:09 ERROR download_util.py:330 Failed to fetch the file size of the file http://download.nutanix.com/lcm/2.0/modules/release-smc-nvme_update-47wb1f8387ffde7q5a5a08ae12ar9f60025c.tgz: 22 (, curl: (
22) The requested URL returned error: 403 Forbidden )
2020-09-07 21:06:09 ERROR download_util.py:131 Could not retrieve the size of image http://download.nutanix.com/lcm/2.0/modules/release-smc-nvme_update-w550f3747b1f8387eera12a9f60025cwa8eqw.tgz: curl: (22) The requested URL returned error: 403 Forbidden

Solution :-

You can run the script “lcm_catalog_cleanup”. There is no downtime required to run the script

Need to have internet connectivity for port 80 and 443.

if port 80 is not open you can download to your local PC “lcm_catolog_cleanup

Copy the content of the script and paste in any CVM bin directory.

Ex. nutanix@NTNX-PROD-CVM:~/cluster/bin$vi catalog_leader_printer
    nutanix@NTNX-PROD-CVM:~/cluster/bin$ ./catalog_leader_printer
    Catalog leader is at X.X.X.87

With internet connectivity

First we need to find the catlog leader using the “catalog_leader_printer” batch Script.

nutanix@NTNX-PROD-CVM:~ cd /home/nutanix/cluster/bin/
nutanix@cvm:~/cluster/bin$ wget http://download.nutanix.com/kbattachments/8027/catalog_leader_printer
nutanix@cvm:~/cluster/bin$ chmod +x catalog_leader_printer
nutanix@cvm:~/cluster/bin$ ./catalog_leader_printer
nutanix@NTNX-PROD-CVM:~/cluster/bin$ ./catalog_leader_printer
Catalog leader is at X.X.X.87

if the LCM framework version is greter than 2.3.3

nutanix@NTNX-PROD-CVM:~cd /home/nutanix/cluster/bin/lcm
nutanix@NTNX-PROD-CVM~/cluster/bin/lcm$python lcm_catalog_cleanup
Found master manifest, attempting to delete it. 
Found product meta, attempting to delete it. 
All items deleted successfully

and run the inventory again you will see the progress .

If with above method issue is not resolved then you can check with your internet connectivity.

nutanix@NTNX-PROD-CVM/cluster/bin/lcm$ curl http://download.nutanix.com/lcm/2.0/master_manifest.tgz -O
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- 0:04:37 --:--:-- 0curl: (7) Failed connect to download.nutanix.com:80; Operation now in progress

If you are using HTTP proxy in prism, try with full internet connectivity sometimes proxy block manifest.

See also :- LCM Operation Issue

Leave a Reply