메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


$>beeline
beeline> !connect jdbc:hive2://gsda4:10000
Connecting to jdbc:hive2://gsda4:10000
Enter username for jdbc:hive2://gsda4:10000: admin
Enter password for jdbc:hive2://gsda4:10000: ********
Connected to: Apache Hive (version 1.1.0-cdh5.15.0)
Driver: Hive JDBC (version 1.1.0-cdh5.15.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://gsda4:10000>
0: jdbc:hive2://gsda4:10000> create role admin_role;
INFO  : Compiling command(queryId=hive_20180806235757_87db8100-df9c-4209-97b8-20e5f1acf6f2): create role admin_role
INFO  : Semantic Analysis Completed
INFO  : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=hive_20180806235757_87db8100-df9c-4209-97b8-20e5f1acf6f2); Time taken: 0.114 seconds
INFO  : Executing command(queryId=hive_20180806235757_87db8100-df9c-4209-97b8-20e5f1acf6f2): create role admin_role
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=hive_20180806235757_87db8100-df9c-4209-97b8-20e5f1acf6f2); Time taken: 0.476 seconds
INFO  : OK
No rows affected (2.104 seconds)
0: jdbc:hive2://gsda4:10000> grant ALL on SERVER server1 to role admin_role;
Error: Error while compiling statement: FAILED: ParseException line 1:31 cannot recognize input near 'admin_role' '<EOF>' '<EOF>' in user|group|role name (state=42000,code=40000)
0: jdbc:hive2://gsda4:10000> grant ALL on SERVER server1 to role admin_role;
INFO  : Compiling command(queryId=hive_20180807000101_a93281e3-616d-4134-9510-dc87204af950): grant ALL on SERVER server1 to role admin_role
INFO  : Semantic Analysis Completed
INFO  : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=hive_20180807000101_a93281e3-616d-4134-9510-dc87204af950); Time taken: 0.151 seconds
INFO  : Executing command(queryId=hive_20180807000101_a93281e3-616d-4134-9510-dc87204af950): grant ALL on SERVER server1 to role admin_role
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=hive_20180807000101_a93281e3-616d-4134-9510-dc87204af950); Time taken: 0.24 seconds
INFO  : OK
No rows affected (0.428 seconds)
0: jdbc:hive2://gsda4:10000> grant role admin_role to group admin;
INFO  : Compiling command(queryId=hive_20180807000202_747dc4ce-0290-4545-b630-49050fff6f8f): grant role admin_role to group admin
INFO  : Semantic Analysis Completed
INFO  : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=hive_20180807000202_747dc4ce-0290-4545-b630-49050fff6f8f); Time taken: 0.088 seconds
INFO  : Executing command(queryId=hive_20180807000202_747dc4ce-0290-4545-b630-49050fff6f8f): grant role admin_role to group admin
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=hive_20180807000202_747dc4ce-0290-4545-b630-49050fff6f8f); Time taken: 0.074 seconds
INFO  : OK
No rows affected (0.185 seconds)
0: jdbc:hive2://gsda4:10000>





gooper@gsda1:~$ beeline -u 'jdbc:hive2://gsda4:10000/'     
scan complete in 5ms
Connecting to jdbc:hive2://gsda4:10000/
Connected to: Apache Hive (version 1.1.0-cdh5.15.0)
Driver: Hive JDBC (version 1.1.0-cdh5.15.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.1.0-cdh5.15.0 by Apache Hive
0: jdbc:hive2://gsda4:10000/> 


----test.mode설정이 안된 경우 오류내용(sentry.hive.testing.mode)------
[root@cloudera1 ~]# beeline -u 'jdbc:hive2://cloudera3:10000/'
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
scan complete in 4ms
Connecting to jdbc:hive2://cloudera3:10000/
Connected to: Apache Hive (version 1.1.0-cdh5.15.0)
Driver: Hive JDBC (version 1.1.0-cdh5.15.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.1.0-cdh5.15.0 by Apache Hive
0: jdbc:hive2://cloudera3:10000/> show tables;
Error: Error while compiling statement: FAILED: InvalidConfigurationException hive.server2.authentication can't be none in non-testing mode (state=42000,code=40000)

번호 제목 글쓴이 날짜 조회 수
300 bin/start-hbase.sh실행시 org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded오류가 발생하면 조치사항 총관리자 2016.08.01 205
299 kafkaWordCount.scala의 producer와 consumer 클래스를 이용하여 kafka를 이용한 word count 테스트 하기 총관리자 2016.08.02 97
298 down된 broker로 메세지를 전송하려는 경우의 오류 내용및 조치사항 총관리자 2016.08.12 238
297 kafka 0.9.0.1버젼의 producer와 kafka버젼이 0.10.0.1인 consumer가 서로 대화하는 모습 총관리자 2016.08.18 288
296 No broker partitions consumed by consumer thread오류 발생시 확인/조치할 사항 총관리자 2016.09.02 151
295 AIX 7.1에 Hadoop설치(정리중) 총관리자 2016.09.12 236
294 AIX 7.1에 Hadoop설치(정리중#2) 총관리자 2016.09.20 215
293 format된 namenode를 다른 서버에서 다시 format했을때 오류내용 총관리자 2016.09.22 155
292 hadoop 어플리케이션을 사용하는 사용자 변경시 바꿔줘야 하는 부분 총관리자 2016.09.23 68
291 ./hadoop-daemon.sh start namenode로 namenode기동시 EditLog의 custerId, namespaceId가 달라서 발생하는 오류 해결방법 총관리자 2016.09.24 119
290 AIX 7.1에 MariaDB 10.2 소스 설치 총관리자 2016.09.24 2367
289 파일끝에 붙는 ^M 일괄 지우기(linux, unix(AIX)) 혹은 파일내에 있는 ^M지우기 총관리자 2016.09.24 78
288 schema설정없이 hive를 최초에 실행했을때 발생하는 오류메세지및 처리방법 총관리자 2016.09.25 1226
287 hive기동시 Caused by: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D 오류 발생시 조치사항 총관리자 2016.09.25 496
286 AIX 7.1에서 hive실행시 "hive: line 86: readlink: command not found" 오류가 발생시 임시 조치사항 총관리자 2016.09.25 234
285 java.lang.OutOfMemoryError: unable to create new native thread오류 발생지 조치사항 총관리자 2016.10.17 469
284 producer / consumer구현시 설정 옵션 설명 총관리자 2016.10.19 121
283 운영중인 상태에서 kafka topic삭제하고 재생성하여 처리되지 않은 메세지 모두 삭제하기 총관리자 2016.10.24 156
282 VisualVM 1.3.9을 이용한 spark-submit JVM 모니터링을 위한 설정및 spark-submit실행 옵션 총관리자 2016.10.28 1891
281 How-to: Tune Your Apache Spark Jobs (Part 2) file 총관리자 2016.10.31 77

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로