elasticsearch-hadoop.jar 6.8版本编译异常

2023-12-28 12:59:13

## 背景

重新编译?elasticsearch-hadoop 包;

GitHub - elastic/elasticsearch-hadoop at 6.8

编译 7.17 版本时很正常,注意设置下环境变量就好,JAVA8_HOME/....

编译 6.8 版本时(要求jdk8 / jdk9),出现异常

1. Could not resolve org.springframework.build.gradle:propdeps-plugin:0.0.7.

2.?Could not resolve cascading:cascading-local:2.6.3.

3.?Could not resolve org.elasticsearch.gradle:build-tools:6.8.24-SNAPSHOT

4.?Could not resolve cascading:cascading-hadoop:2.6.3.

## 分析(尝试逐个解决)

1. gradle 仓库修改

    // ali库 解决 Could not resolve org.springframework.build.gradle:propdeps-plugin:0.0.7.
    maven{ url 'https://maven.aliyun.com/repository/central'}
    maven{ url 'https://maven.aliyun.com/repository/public' }
    maven{ url 'https://maven.aliyun.com/repository/google'}
    maven{ url 'https://maven.aliyun.com/repository/gradle-plugin'}
    maven{ url 'https://maven.aliyun.com/repository/spring'}
    maven{ url 'https://maven.aliyun.com/repository/spring-plugin'}
    maven{ url 'https://maven.aliyun.com/mvn/guide'}
    maven{ url 'https://maven.aliyun.com/repository/apache-snapshots'}

2. esh-version.properties 修改

6.8.24-SNAPSHOT -> 6.8.23

3.?cascading-local 这个包始终无法获取

## 最终解决

本质原因有2个,一个是?repo.spring.io 改造成需要验证了,不验证会有401;另一个是http://conjars.org/repo 已经失效了,需要替换;

所以前面修改的全部回滚,完整解决方案如下:

1. 处理 propdeps-plugin 包,增加阿里云的库

    // ali库 propdeps-plugin
    maven{ url 'https://maven.aliyun.com/repository/central'}
    maven{ url 'https://maven.aliyun.com/repository/public' }
    maven{ url 'https://maven.aliyun.com/repository/google'}
    maven{ url 'https://maven.aliyun.com/repository/gradle-plugin'}
    maven{ url 'https://maven.aliyun.com/repository/spring'}
    maven{ url 'https://maven.aliyun.com/repository/spring-plugin'}
    maven{ url 'https://maven.aliyun.com/mvn/guide'}
    maven{ url 'https://maven.aliyun.com/repository/apache-snapshots'}

2. 修改?buildSrc/src/main/groovy/org/elasticsearch/hadoop/gradle/BuildPlugin.groovy

全部的 http://conjars.org/repo 或者 https://conjars.org/repo

替换成 https://conjars.wensel.net/repo

## 参考:

1.?Notice of Permissions Changes to repo.spring.io, January 2023

2.?https://segmentfault.com/q/1010000043853512

3.?spring源码编译问题解决1,Received status code 401 from server问题,not found问题,更换阿里云镜像_received status code 401 from server:-CSDN博客

?4.?https://github.com/elastic/elasticsearch-hadoop/issues/984

?5.?How to build a plugin for a not yet released version? - Elasticsearch - Discuss the Elastic Stack

6.?conjars.org: Connection timed out_http://conjars.org/repo 地址失效-CSDN博客

文章来源:https://blog.csdn.net/qq_33999844/article/details/135257626
本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。