메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


CDH설치중 아래와 같이 오류가 발생하면서 cloudera agent가 설치되지 않는 경우가 있는데 이는 apt-get update를 실행하면서 package "apt-transport-https"가 설치되지 않아서 발생하는 문제이므로 sudo apt-get install apt-transport-https를 실행후 agent설치를 retry해준다.


----------sudo apt-get update를 실행하여 보여지는 에러 메세지--------------

gooper@gsda3:/etc/apt/sources.list.d$ sudo apt-get update

Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease

Hit:2 http://archive.ubuntu.com/ubuntu xenial InRelease                                        

Hit:3 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease                        

Hit:4 http://archive.ubuntu.com/ubuntu xenial-updates InRelease                                    

Hit:5 http://ftp.kaist.ac.kr/mariadb/repo/10.1/ubuntu xenial InRelease  

Reading package lists... Done

E: The method driver /usr/lib/apt/methods/https could not be found.

N: Is the package apt-transport-https installed?

E: Failed to fetch https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.14.2/InRelease  

E: Some index files failed to download. They have been ignored, or old ones used instead.


-------apt-transport-https패키지를 설치하는 메세지-------------

gooper@gsda3:/etc/apt/sources.list.d$ sudo apt-get install apt-transport-https

Reading package lists... Done

Building dependency tree       

Reading state information... Done

The following package was automatically installed and is no longer required:

  postgresql

Use 'sudo apt autoremove' to remove it.

The following NEW packages will be installed:

  apt-transport-https

0 upgraded, 1 newly installed, 0 to remove and 3 not upgraded.

Need to get 26.1 kB of archives.

After this operation, 215 kB of additional disk space will be used.

Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt-transport-https amd64 1.2.26 [26.1 kB]

Fetched 26.1 kB in 3s (7,659 B/s)                    

Selecting previously unselected package apt-transport-https.

(Reading database ... 35334 files and directories currently installed.)

Preparing to unpack .../apt-transport-https_1.2.26_amd64.deb ...

Unpacking apt-transport-https (1.2.26) ...

Setting up apt-transport-https (1.2.26) ...


-----------------------CM설치하면서 보여지는 오류 메세지-----------------

/tmp/scm_prepare_node.DD6Kh9k4 

using SSH_CLIENT to get the SCM hostname: 104.251.212.146 57750 10022 

opening logging file descriptor 

Starting installation script...

Acquiring installation lock...

BEGIN flock 4 

END (0) 

Detecting root privileges...

effective UID is 1001 

BEGIN which pbrun 

END (1) 

BEGIN sudo -S id 

uid=0(root) gid=0(root) groups=0(root) 

END (0) 

Using 'sudo ' to acquire root privileges 

Detecting distribution...

BEGIN grep 'Ubuntu' /etc/lsb-release 

DISTRIB_ID=Ubuntu 

DISTRIB_DESCRIPTION="Ubuntu 16.04.4 LTS" 

END (0) 

BEGIN grep DISTRIB_CODENAME /etc/lsb-release 

END (0) 

DISTRIB_CODENAME=xenial 

BEGIN echo DISTRIB_CODENAME=xenial | cut -d = -f 2 

xenial 

END (0) 

Detecting Cloudera Manager Server...

BEGIN host -t PTR 104.251.212.146 

/tmp/scm_prepare_node.DD6Kh9k4/scm_prepare_node.sh: line 104: host: command not found 

END (127) 

BEGIN which python 

/usr/bin/python 

END (0) 

BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 104.251.212.146 7182 

END (0) 

BEGIN which wget 

END (0) 

/usr/bin/wget 

BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo 

END (4) 

Installing package repositories...

validating format of repository file /tmp/scm_prepare_node.DD6Kh9k4/repos/ubuntu_xenial/cloudera-manager.list 

installing repository file /tmp/scm_prepare_node.DD6Kh9k4/repos/ubuntu_xenial/cloudera-manager.list 

repository file /tmp/scm_prepare_node.DD6Kh9k4/repos/ubuntu_xenial/cloudera-manager.list installed 

BEGIN sudo apt-key add /tmp/scm_prepare_node.DD6Kh9k4/archive.key 

OK 

END (0) 

installing priority file /tmp/scm_prepare_node.DD6Kh9k4/priorities/ubuntu_xenial/cloudera.pref 

priority file /tmp/scm_prepare_node.DD6Kh9k4/priorities/ubuntu_xenial/cloudera.pref installed 

Refreshing package metadata...

BEGIN sudo apt-get update 

Hit:1 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease 

Hit:2 http://archive.ubuntu.com/ubuntu xenial InRelease 

Hit:3 http://archive.ubuntu.com/ubuntu xenial-updates InRelease 

Hit:4 http://ftp.kaist.ac.kr/mariadb/repo/10.1/ubuntu xenial InRelease 

Hit:5 http://security.ubuntu.com/ubuntu xenial-security InRelease 

Reading package lists... 

E: The method driver /usr/lib/apt/methods/https could not be found. 

E: Failed to fetch https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.14.2/InRelease 

E: Some index files failed to download. They have been ignored, or old ones used instead. 

END (100) 

BEGIN sudo apt-get update 

Hit:1 http://security.ubuntu.com/ubuntu xenial-security InRelease 

Hit:2 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease 

Hit:3 http://archive.ubuntu.com/ubuntu xenial InRelease 

Hit:4 http://archive.ubuntu.com/ubuntu xenial-updates InRelease 

Hit:5 http://ftp.kaist.ac.kr/mariadb/repo/10.1/ubuntu xenial InRelease 

Reading package lists... 

E: The method driver /usr/lib/apt/methods/https could not be found. 

E: Failed to fetch https://archive.cloudera.com/cm5/ubuntu/xenial/amd64/cm/dists/xenial-cm5.14.2/InRelease 

E: Some index files failed to download. They have been ignored, or old ones used instead. 

END (100) 

Installing cloudera-manager-agent package...

BEGIN sudo dpkg -l cloudera-manager-agent | grep -E '^ii[[:space:]]*cloudera-manager-agent[[:space:]]*' 

dpkg-query: no packages found matching cloudera-manager-agent 

END (1) 

BEGIN sudo apt-cache show cloudera-manager-agent 

E: No packages found 

END (100) 

cloudera-manager-agent must have Version=5.14.2 and Build=8, exiting


번호 제목 글쓴이 날짜 조회 수
500 Cannot create /var/run/oozie/oozie.pid: Directory nonexistent오류 총관리자 2014.06.03 479
499 java.util.NoSuchElementException발생시 조치 총관리자 2014.08.27 476
498 Ubuntu 16.04 LTS에 Hive 2.1.1설치하면서 "Version information not found in metastore"발생하는 오류원인및 조치사항 총관리자 2017.05.03 469
497 java.lang.OutOfMemoryError: unable to create new native thread오류 발생지 조치사항 총관리자 2016.10.17 466
496 Spark 1.6.1 설치후 HA구성 총관리자 2016.05.24 455
» CDH 5.14.2 설치중 agent설치에서 실패하는 경우 확인/조치 총관리자 2018.05.22 450
494 java.lang.IllegalArgumentException: Does not contain a valid host:port authority: master 오류해결방법 총관리자 2015.05.06 449
493 Elastic Search For Hadoop 2.2.0설치하기(5대 클러스터링) 총관리자 2016.04.04 447
492 servlet-api를 jar형태로 build할때 포함하지 말고 java 설치 위치의 jre/lib/ext에 복사하여 사용하는것이 좋다. 총관리자 2016.08.10 446
491 spark-sql실행시 The specified datastore driver ("com.mysql.jdbc.Driver") was not found in the CLASSPATH오류 발생시 조치사항 총관리자 2016.06.09 441
490 [번역] solr 검색 엔진 튜토리얼 총관리자 2014.10.07 441
489 Drools 6.0 - 비즈니스 룰 기반으로 간단한 룰 애플리케이션 만들기 file 총관리자 2016.07.18 440
488 Could not configure server becase SASL configuration did not allow the Zookeeper server to authenticate itself properly: javax.security.auth.login.LoginException: Checksum failed 총관리자 2019.05.18 434
487 Java 8에서 pom.xml에 JavaDoc 관련 태그가 설정되어 있으나 오류등으로 실패하면 나머지 Maven작업이 종료되는 문제 해결 방법 총관리자 2017.01.24 432
486 elasticsearch 기동시 permission denied on key 'vm.max_map_count' 오류발생시 조치사항 총관리자 2017.06.23 431
485 db를 통째로 새로운 이름의 db로 복사하는 방법/절차 총관리자 2017.11.14 428
484 ontology, jena, sparql등 전반에 대한 설명및 예제를 제공하는 사이트 총관리자 2015.12.08 427
483 Hadoop - 클러스터 세팅및 기동 총관리자 2015.04.28 427
482 Error: Could not find or load main class nodemnager 가 발생할때 해결하는 방법 총관리자 2015.06.05 426
481 Tracking URL = N/A 가발생하는 경우 - 환경설정값을 잘못설정하는 경우에 발생함 총관리자 2015.06.17 423

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로