diff --git a/README.md b/README.md index ad86d68..3001c09 100644 --- a/README.md +++ b/README.md @@ -1,15 +1,15 @@ # Maven Index Exporter This Docker image reads a Maven Indexer index and extract information about the indexed documents as a convenient text file. It takes as input the full set of Maven indexes files, as can be seen in the central maven repository, and uses two Java tools ([maven-indexer-cli](https://maven.apache.org/maven-indexer/) and [clue](https://github.com/javasoze/clue)) to extract the indexes (in `indexes/`) and export them in the `export/` directory. * You can read more about the sequence of actions in the `docs/` directory, including: * [more information about the process](docs/README.md). -* [instructions to run the exporter](docs/run_maven-index-exporter.md). +* [instructions to run the exporter](docs/run_maven_index_exporter.md). * [instructions to build and test](docs/build_and_test.md) the Docker image. An official Docker image is provided for quick tests on [DockerHub](https://hub.docker.com/r/bbaldassari/maven-index-exporter). diff --git a/docs/maven_repositories/list_maven_ok.txt b/docs/maven_repositories/list_maven_repositories_with_index.txt similarity index 93% rename from docs/maven_repositories/list_maven_ok.txt rename to docs/maven_repositories/list_maven_repositories_with_index.txt index faf9f42..a1c6800 100644 --- a/docs/maven_repositories/list_maven_ok.txt +++ b/docs/maven_repositories/list_maven_repositories_with_index.txt @@ -1,307 +1,333 @@ http://apps.geomajas.org/nexus/content/repositories/snapshots/ http://artifactory.javassh.com/opensource-releases/ http://artifactory.javassh.com/opensource-snapshots/ http://artifactory.mycore.de/libs-releases-local/ http://artifactory.mycore.de/libs-snapshots-local/ http://artifacts.codice.org/content/groups/public.tar.bz2 http://artifacts.metaborg.org/content/repositories/releases/ http://artifacts.metaborg.org/content/repositories/snapshots/ http://bp-cms-commons.sourceforge.net/m2repo/ http://ci.qaprosoft.com/8081/nexus/content/repositories/snapshots/ http://clojars.org/repo/ http://dist.wso2.org/maven2/ http://dist.wso2.org/snapshots/maven2/ http://files.couchbase.com/maven2/ http://forum.soapui.org/repository/maven2/ http://java.freehep.org/maven2/ http://m2.duraspace.org/content/repositories/thirdparty/ http://maven.alfresco.com/nexus/content/repositories/releases/ http://maven.atlassian.com/public/ http://maven.atlassian.com/repository/public/ http://maven.ecs.soton.ac.uk/content/repositories/openimaj-releases/ http://maven.ecs.soton.ac.uk/content/repositories/openimaj-snapshots/ http://maven.geomajas.org/ http://maven.imagej.net/content/groups/public/ http://maven.imagej.net/content/repositories/thirdparty/ http://maven.inria.fr/artifactory/malai-public-snapshot/ http://maven.inria.fr/artifactory/spoon-public-snapshot/ http://maven.jahia.org/maven2/ http://maven.jarch.com.br/releases/ http://maven.jarch.com.br/snapshots/ http://maven.java.net/content/repositories/releases/ http://maven.java.net/content/repositories/snapshots/ http://maven.java.net/content/repositories/staging/ http://maven.nuxeo.org/nexus/content/groups/public/ http://maven.objectstyle.org/nexus/content/groups/cayenne-deps/ http://maven.objectstyle.org/nexus/content/groups/linkrest/ http://maven.objectstyle.org/nexus/content/repositories/bootique-snapshots/ http://maven.objectstyle.org/nexus/content/repositories/linkrest-snapshots/ http://maven.objectweb.org/maven2/ http://maven.onehippo.com/maven2/ http://maven.openimaj.org/ http://maven.ow2.org/maven2/ http://mavenrepo.openmrs.org/nexus/content/repositories/releases/ http://mavenrepo.openmrs.org/nexus/content/repositories/snapshots/ http://maven.repository.redhat.com/earlyaccess/all/ http://maven.repository.redhat.com/techpreview/all/ http://mavensync.zkoss.org/maven2/ http://maven.vaadin.com/vaadin-addons/ http://maven.vaadin.com/vaadin-prereleases/ http://maven.wso2.org/nexus/content/groups/wso2-public/ http://maven.wso2.org/nexus/content/repositories/releases/ http://maven.wso2.org/nexus/content/repositories/snapshots/ http://maven.xwiki.org/releases/ http://nexus.ala.org.au/content/repositories/releases/ http://nexus.ala.org.au/content/repositories/snapshots/ http://nexus.fd.io/content/repositories/fd.io.release/ http://nexus.nuiton.org/nexus/content/groups/scmwebeditor/ http://nexus.opencast.org/nexus/content/groups/public/ http://nexus.opendaylight.org/content/groups/public/ http://nexus.opendaylight.org/content/repositories/opendaylight.release/ http://nexus.opendaylight.org/content/repositories/opendaylight.snapshot/ http://nexus.opendaylight.org/content/repositories/public/ http://nexus.synyx.de/content/repositories/public-releases/ http://nexus.synyx.de/content/repositories/public-snapshots/ http://nexus.xwiki.org/nexus/content/groups/public/ http://nexus.xwiki.org/nexus/content/groups/public-snapshots/ http://nexus.xwiki.org/nexus/content/repositories/releases/ http://nexus.xwiki.org/nexus/content/repositories/snapshots/ http://nexus.xwiki.org/nexus/content/repositories/snapshots// http://nexus.yifengx.com/content/repositories/releases/ http://origin-repository.jboss.org/nexus/content/groups/ea/ http://oss.sonatype.org/content/repositories/releases/ http://repo.adobe.com/nexus/content/groups/public/ http://repo.anahata.uno/artifactory/anahata-public/ http://repo.basepoint.su/content/groups/public/ http://repo.evolvedbinary.com/repository/exist-db/ http://repo.fusesource.com/maven2/ http://repo.fusesource.com/maven2// http://repo.fusesource.com/nexus/content/groups/public/ http://repo.fusesource.com/nexus/content/repositories/releases/ http://repo.fusesource.com/nexus/content/repositories/snapshots/ http://repo.hedgecode.org/content/repositories/releases/ http://repo.hedgecode.org/content/repositories/releases// http://repo.hedgecode.org/content/repositories/snapshots/ http://repo.hedgecode.org/content/repositories/snapshots// http://repo.heigit.org/artifactory/main/ http://repo.jenkins-ci.org/public/ http://repo.jenkins-ci.org/releases/ http://repository.apache.org/content/groups/snapshots/ http://repository.apache.org/content/groups/snapshots// http://repository.apache.org/content/groups/snapshots-group/ http://repository.apache.org/content/repositories/snapshots/ http://repository.apache.org/snapshots/ http://repository.exoplatform.org/content/repositories/juzu-snapshots/ http://repository.exoplatform.org/public/ http://repository.jboss.org/maven2/ http://repository.mulesoft.org/releases/ http://repository.mulesoft.org/snapshots/ http://repository.ow2.org/nexus/content/repositories/releases/ http://repository.ow2.org/nexus/content/repositories/snapshots/ http://repository.sonatype.org/content/groups/flexgroup/ http://repository.sonatype.org/content/groups/forge/ http://repository.sonatype.org/content/groups/public/ http://repository.sonatype.org/content/groups/sonatype-public-grid/ http://repository.sonatype.org/content/repositories/flexmojos-releases/ http://repository.sonatype.org/content/repositories/flexmojos-snapshots/ http://repository.sonatype.org/content/repositories/nexus-plugins-snapshots/ http://repository.sonatype.org/content/repositories/releases/ http://repository.sonatype.org/content/repositories/snapshots/ http://repository.sonatype.org/content/repositories/tycho-pseudo-releases/ http://repo.spring.io/libs-milestone/ http://repo.spring.io/libs-milestone-local/ http://repo.spring.io/libs-release/ http://repo.spring.io/libs-release-local/ http://repo.spring.io/libs-snapshot/ http://repo.spring.io/libs-snapshot-local/ http://repo.spring.io/milestone/ http://repo.spring.io/milestone// http://repo.spring.io/plugins-release/ http://repo.spring.io/plugins-release// http://repo.spring.io/plugins-release-local/ http://repo.spring.io/plugins-snapshot-local/ http://repo.spring.io/release/ http://repo.spring.io/snapshot/ http://repos.zeroturnaround.com/nexus/content/groups/zt-public/ http://repo.terasoluna.org/nexus/content/repositories/terasoluna-batch-releases/ http://repo.terasoluna.org/nexus/content/repositories/terasoluna-batch-snapshots/ http://repo.terasoluna.org/nexus/content/repositories/terasoluna-gfw-releases/ http://repo.terasoluna.org/nexus/content/repositories/terasoluna-gfw-snapshots/ https://artifactory.openntf.org/openntf/ https://artifacts.alfresco.com/nexus/content/groups/public/ https://artifacts.alfresco.com/nexus/content/groups/public-snapshots/ https://artifacts.alfresco.com/nexus/content/repositories/activiti-releases/ https://artifacts.alfresco.com/nexus/content/repositories/activiti-snapshots/ https://artifacts.alfresco.com/nexus/content/repositories/public/ https://artifacts.alfresco.com/nexus/content/repositories/releases/ https://artifacts.alfresco.com/nexus/content/repositories/snapshots/ https://artifacts.metaborg.org/content/repositories/snapshots/ https://artifacts.metaborg.org/content/repositories/snapshots// https://artifacts-oss.talend.com/nexus/content/repositories/TalendOpenSourceRelease/ https://artifacts-oss.talend.com/nexus/content/repositories/TalendOpenSourceSnapshot/ https://artifacts-zl.talend.com/nexus/content/repositories/TalendOpenSourceRelease/ https://artifacts-zl.talend.com/nexus/content/repositories/TalendOpenSourceSnapshot/ https://build.shibboleth.net/nexus/content/repositories/public/ https://build.shibboleth.net/nexus/content/repositories/releases/ https://build.shibboleth.net/nexus/content/repositories/snapshots/ https://ci.qaprosoft.com/nexus/content/repositories/snapshots/ https://clojars.org/repo/ https://dev.majordodo.org/nexus/content/repositories/releases/ https://dev.majordodo.org/nexus/content/repositories/snapshots/ https://dev.majordodo.org/nexus/content/repositories/snapshots// https://dist.wso2.org/maven2/ https://jakarta.oss.sonatype.org/content/repositories/snapshots/ https://jakarta.oss.sonatype.org/content/repositories/staging/ https://jitpack.io/ https://m2.duraspace.org/content/repositories/releases/ https://m2.duraspace.org/content/repositories/snapshots/ https://m2.duraspace.org/content/repositories/thirdparty/ https://m2proxy.atlassian.com/repository/public/ https://maven.atlassian.com/central-snapshot/ https://maven.atlassian.com/content/groups/public/ https://maven.atlassian.com/content/repositories/atlassian-public/ https://maven.atlassian.com/private/ https://maven.atlassian.com/private-snapshot/ https://maven.atlassian.com/public/ https://maven.atlassian.com/public-snapshot/ https://maven.atlassian.com/repository/public/ https://maven-central.storage-download.googleapis.com/repos/central/data/ https://maven.imagej.net/content/groups/public/ https://maven.java.net/content/groups/promoted/ https://maven.java.net/content/repositories/promoted/ https://maven.java.net/content/repositories/promoted// https://maven.java.net/content/repositories/releases/ https://maven.java.net/content/repositories/releases// https://maven.java.net/content/repositories/snapshots/ https://maven.java.net/content/repositories/staging/ https://maven.mag-news.it/content/repositories/releases/ https://maven.objectstyle.org/nexus/content/groups/cayenne-deps/ https://maven.objectstyle.org/nexus/content/groups/linkrest/ https://maven.objectstyle.org/nexus/content/repositories/bootique-snapshots/ https://maven.objectstyle.org/nexus/content/repositories/linkrest-snapshots/ https://maven.oracle.com/ https://mavenrepo.openmrs.org/releases/ https://mavenrepo.openmrs.org/snapshots/ https://maven.repository.redhat.com/earlyaccess/all/ https://maven.repository.redhat.com/ga// https://maven.repository.redhat.com/techpreview/all// https://maven.scijava.org/content/groups/public/ https://maven.vaadin.com/vaadin-prereleases// https://maven.wso2.org/nexus/content/groups/wso2-public/ https://maven.wso2.org/nexus/content/repositories/releases/ https://maven.wso2.org/nexus/content/repositories/snapshots/ https://nexus.ala.org.au/content/repositories/releases/ https://nexus.ala.org.au/content/repositories/snapshots/ https://nexus.nuiton.org/nexus/content/repositories/central-releases/ https://nexus.nuiton.org/nexus/content/repositories/snapshots/ https://nexus.opencast.org/nexus/content/groups/public/ https://nexus.xwiki.org/nexus/content/groups/public/ https://nexus.xwiki.org/nexus/content/groups/public-snapshots/ https://nexus.xwiki.org/nexus/content/repositories/snapshots/ https://origin-repository.jboss.org/nexus/content/groups/ea/ https://oss.sonatype.org/content/repositories/releases/ https://packages.atlassian.com/maven/central/ https://packages.atlassian.com/maven/central-snapshot/ https://packages.atlassian.com/maven/public/ https://packages.atlassian.com/maven/public-snapshot/ https://packages.atlassian.com/maven/repository/public/ https://packages.atlassian.com/mvn/maven-external/ https://repo1.maven.org/maven2/ https://repo.adobe.com/nexus/content/groups/public/ https://repo.eclipse.org/content/groups/cbi/ https://repo.eclipse.org/content/groups/microprofile/ https://repo.eclipse.org/content/groups/releases// https://repo.eclipse.org/content/groups/snapshots/ https://repo.eclipse.org/content/repositories/californium-releases// https://repo.eclipse.org/content/repositories/californium-snapshots/ https://repo.eclipse.org/content/repositories/cbi/ https://repo.eclipse.org/content/repositories/cbi-releases// https://repo.eclipse.org/content/repositories/cbi-snapshots// https://repo.eclipse.org/content/repositories/dash-licenses-releases/ https://repo.eclipse.org/content/repositories/dash-licenses-snapshots// https://repo.eclipse.org/content/repositories/ditto-releases/ https://repo.eclipse.org/content/repositories/ditto-snapshots/ https://repo.eclipse.org/content/repositories/ebr-releases/ https://repo.eclipse.org/content/repositories/ebr-snapshots/ https://repo.eclipse.org/content/repositories/ecf-releases/ https://repo.eclipse.org/content/repositories/ecf-snapshots/ https://repo.eclipse.org/content/repositories/geomesa-releases/ https://repo.eclipse.org/content/repositories/geomesa-snapshots/ https://repo.eclipse.org/content/repositories/hawkbit-releases/ https://repo.eclipse.org/content/repositories/hawkbit-snapshots/ https://repo.eclipse.org/content/repositories/hono-releases/ https://repo.eclipse.org/content/repositories/hono-snapshots/ https://repo.eclipse.org/content/repositories/jax-rs-api-releases/ https://repo.eclipse.org/content/repositories/jax-rs-api-snapshots/ https://repo.eclipse.org/content/repositories/jgit-releases/ https://repo.eclipse.org/content/repositories/jgit-snapshots/ https://repo.eclipse.org/content/repositories/jts-snapshots/ https://repo.eclipse.org/content/repositories/leshan-releases/ https://repo.eclipse.org/content/repositories/leshan-snapshots/ https://repo.eclipse.org/content/repositories/lyo-releases/ https://repo.eclipse.org/content/repositories/lyo-snapshots/ https://repo.eclipse.org/content/repositories/microprofile-releases/ https://repo.eclipse.org/content/repositories/microprofile-snapshots/ https://repo.eclipse.org/content/repositories/nattable-releases/ https://repo.eclipse.org/content/repositories/nattable-snapshots/ https://repo.eclipse.org/content/repositories/paho-releases/ https://repo.eclipse.org/content/repositories/paho-snapshots/ https://repo.eclipse.org/content/repositories/proj4j-releases/ https://repo.eclipse.org/content/repositories/proj4j-snapshots/ https://repo.eclipse.org/content/repositories/releases// https://repo.eclipse.org/content/repositories/scout-releases/ https://repo.eclipse.org/content/repositories/scout-snapshots/ https://repo.eclipse.org/content/repositories/snapshots/ https://repo.eclipse.org/content/repositories/tycho-snapshots/ https://repo.eclipse.org/content/repositories/yasson-releases/ https://repo.eclipse.org/content/repositories/yasson-snapshots/ https://repo.fusesource.com/nexus/content/groups/public/ https://repo.hedgecode.org/content/repositories/releases/ https://repo.hedgecode.org/content/repositories/snapshots/ https://repo.heigit.org/artifactory/main/ https://repo.huaweicloud.com/repository/maven/ https://repo.jenkins-ci.org/public/ https://repo.jenkins-ci.org/releases// https://repo.locationtech.org/content/repositories/geomesa-releases/ https://repo.locationtech.org/content/repositories/geomesa-snapshots/ https://repo.locationtech.org/content/repositories/jts-snapshots/ https://repo.locationtech.org/content/repositories/proj4j-releases/ https://repo.locationtech.org/content/repositories/proj4j-snapshots/ https://repo.openminted.eu/content/repositories/snapshots/ https://repo.osgeo.org/repository/geotools-releases/ https://repo.osgeo.org/repository/geotools-snapshots/ https://repo.osgeo.org/repository/release/ https://repo.osgeo.org/repository/snapshot/ https://repository.apache.org/content/groups/public// https://repository.apache.org/content/groups/snapshots// https://repository.apache.org/content/groups/snapshots-group// https://repository.apache.org/content/groups/staging/ https://repository.apache.org/content/repositories/releases// https://repository.apache.org/content/repositories/snapshots// https://repository.apache.org/snapshots/ https://repository.cloudera.com/artifactory/cloudera-repos/ https://repository.cloudera.com/artifactory/ext-release-local/ https://repository.jboss.org/maven2/ https://repository.jboss.org/nexus/content/repositories/deprecated/ https://repository.jboss.org/nexus/content/repositories/fs-releases/ https://repository.jboss.org/nexus/content/repositories/fs-snapshots/ https://repository.jboss.org/nexus/content/repositories/releases/ https://repository.jboss.org/nexus/content/repositories/thirdparty-releases/ https://repository.liferay.com/nexus/content/groups/public/ https://repository.liferay.com/nexus/content/repositories/liferay-public-releases/ https://repository.liferay.com/nexus/content/repositories/liferay-releases-ce/ https://repository-master.mulesoft.org/nexus/content/repositories/releases// https://repository-master.mulesoft.org/nexus/content/repositories/snapshots/ https://repository-master.mulesoft.org/releases/ https://repository-master.mulesoft.org/snapshots/ https://repository.mulesoft.org/nexus/content/repositories/public/ https://repository.mulesoft.org/nexus/content/repositories/releases/ https://repository.mulesoft.org/nexus/content/repositories/snapshots/ https://repository.mulesoft.org/releases// https://repository.mulesoft.org/snapshots// https://repository.ow2.org/nexus/content/repositories/snapshots/ https://repository.sonatype.org/content/groups/flexgroup/ https://repository.sonatype.org/content/groups/forge/ https://repository.sonatype.org/content/groups/forge// https://repository.sonatype.org/content/groups/public/ https://repository.sonatype.org/content/groups/sonatype-public-grid// +https://repository.sonatype.org/content/groups/sonatype-public-grid +https://repository.sonatype.org/content/repositories/releases +https://repository.sonatype.org/content/repositories/snapshots +https://repo.spring.io/libs-milestone +https://repo.spring.io/libs-milestone-local +https://repo.spring.io/libs-release +https://repo.spring.io/libs-release-local +https://repo.spring.io/libs-snapshot +https://repo.spring.io/libs-snapshot-local +https://repo.spring.io/milestone +https://repo.spring.io/plugins-milestone +https://repo.spring.io/plugins-release +https://repo.spring.io/plugins-snapshot +https://repo.spring.io/plugins-snapshot-local +https://repo.spring.io/release +https://repo.spring.io/snapshot +https://repo.springsource.org/libs-release-local +https://repo.springsource.org/libs-snapshot-local +https://repo.springsource.org/plugins-release +https://www.myget.org/F/azure-function/maven +https://www.smartics.eu/nexus/content/groups/public-group +https://www.terracotta.org/download/reflector/releases +http://www.eviware.com/repository/maven2 +http://www.smartics.eu/nexus/content/groups/public-group +http://www.smartics.eu/nexus/content/repositories/public +http://www.soapui.org/repository/maven2 diff --git a/docs/run_maven-index-exporter.md b/docs/run_maven_index_exporter.md similarity index 100% rename from docs/run_maven-index-exporter.md rename to docs/run_maven_index_exporter.md