It seems that metadata generation take about 40 seconds. If we submit a new version of package with deleting previous one, users will observe 404 errors until new metadata will be published.