메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


jena의 data폴더를 hadoop nfs를 이용하여 HDFS상의 폴더에 마운트 시키고 fuseki를 통하여 insert를 시도했을때 아래와 같은 오류가 발생한다.


--------------------------------오류내용-----------------------------
[2016-11-30 15:12:57,072] [sf.SparqlService] [runModifySparql(#497)] [DEBUG] Exception message in runModifySparql() =====> 500 - Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) 


[2016-11-30 15:12:57] TDB        WARN  Exception during 'abort'
org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     WARN  [31076] RC = 500 : Exception during abort - transaction did abort
org.apache.jena.tdb.transaction.TDBTransactionException: Exception during abort - transaction did abort
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:199)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        ... 45 more
[2016-11-30 15:12:57] Fuseki     INFO  [31076] 500 Exception during abort - transaction did abort (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST http://XXX.XXX.XXX.XXX:23030/icbms
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST /icbms :: '' :: [application/x-www-form-urlencoded charset=UTF-8] ? 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] Query = PREFIX  p1:   <http://purl.org/dc/elements/1.1/#> PREFIX  qudt: <http://data.nasa.gov/qudt/owl/qudt#> PREFIX  owl:  <http://www.w3.org/2002/07/owl#> PREFIX  swrlb: <http://www.w3.org/2003/11/swrlb#> PREFIX  xsd:  <http://www.w3.org/2001/XMLSchema#> PREFIX  skos: <http://www.w3.org/2004/02/skos/core#> PREFIX  dim:  <http://data.nasa.gov/qudt/owl/dimension#> PREFIX  rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX  ssn:  <http://purl.oclc.org/NET/ssnx/ssn#> PREFIX  dct:  <http://purl.org/dc/terms/> PREFIX  xsp:  <http://www.owl-ontologies.com/2005/08/07/xsp.owl#> PREFIX  foaf: <http://xmlns.com/foaf/0.1/> PREFIX  cc:   <http://creativecommons.org/ns#> PREFIX  b:    <http://www.onem2m.org/ontology/Base_Ontology#> PREFIX  quantity: <http://data.nasa.gov/qudt/owl/quantity> PREFIX  protege: <http://protege.stanford.edu/plugins/owl/protege#> PREFIX  swrl: <http://www.w3.org/2003/11/swrl#> PREFIX  herit: <http://herit-in/herit-cse/> PREFIX  j.0:  <http://data.qudt.org/qudt/owl/1.0.0/text/> PREFIX  o:    <http://www.iotoasis.org/ontology/> PREFIX  unit: <http://data.nasa.gov/qudt/owl/unit#> PREFIX  rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX  dul:  <http://www.loa-cnr.it/ontologies/DUL.owl#> PREFIX  dc:   <http://purl.org/dc/elements/1.1/>  SELECT  ?loc (if(( ?val < 7 ), o:sunny, o:cloudy) AS ?cond) WHERE   { ?AE       o:hasResource         ?con1 ;               rdf:type              b:Device ;               dul:hasLocation       ?loc ;               o:hasDeviceType       o:temperaturehumidityweatherSensor_7 ;               b:hasFunctionality    ?function .     ?con1     o:hasResource         ?con2 .     ?con2     o:hasLatestContentInstance  ?ci .     ?ci       o:hasContentValue     ?val ;               o:isContentInstanceOf  ?con2 .     ?function  rdf:type             o:MeasureFunctionality ;               b:refersTo            o:weather-aspect   } LIMIT   100 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] exec/select
[2016-11-30 15:12:57] Fuseki     INFO  [31077] 200 OK (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:12:57] Fuseki     WARN  [31078] RC = 500 : Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
org.apache.jena.sparql.JenaTransactionException: Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction.checkNotActive(DatasetGraphTransaction.java:120)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.begin(DatasetGraphTrackActive.java:41)
        at org.apache.jena.fuseki.servlets.HttpAction.beginWrite(HttpAction.java:275)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.execute(SPARQL_Update.java:216)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.executeBody(SPARQL_Update.java:180)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.perform(SPARQL_Update.java:101)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.serviceDispatch(SPARQL_UberServlet.java:294)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:256)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] 500 Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) (0 ms)
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:13:04] Fuseki     INFO  [31062] exec/select
번호 제목 글쓴이 날짜 조회 수
740 [CDP7.1.7] oozie sqoop action으로 import혹은 export수행시 발생한 오류에 대한 자세한 로그 확인 하는 방법 gooper 2024.04.19 0
739 [Impala] alter table구문수행시 "WARNINGS: Impala does not have READ_WRITE access to path 'hdfs://nameservice1/DATA/Temp/DB/source/table01_ccd'" 발생시 조치 gooper 2024.04.26 0
738 [CDP7.1.7, Replication]Encryption Zone내 HDFS파일을 비Encryption Zone으로 HDFS Replication시 User hdfs가 아닌 hadoop으로 수행하는 방법 gooper 2024.01.15 1
737 [CDP7.1.7]Hive Replication수행중 Specified catalog.database.table does not exist : hive.db명.table명 오류 발생시 조치방법 gooper 2024.04.05 1
736 [CDP7.1.7][Replication]Table does not match version in getMetastore(). Table view original text mismatch gooper 2024.01.02 2
735 ./gradlew :composeDown 및 ./gradlew :composeUp 를 성공했을때의 메세지 gooper 2023.02.20 6
734 호출 url현황 gooper 2023.02.21 6
733 [vue storefrontui]외부 API통합하기 참고 문서 총관리자 2022.02.09 7
732 [Cloudera Agent] Metadata-Plugin throttling_logger INFO (713 skipped) Unable to send data to nav server. Will try again. gooper 2022.05.16 7
731 [CDP7.1.7, Hive Replication]Hive Replication진행중 "The following columns have types incompatible with the existing columns in their respective positions " 오류 gooper 2023.12.27 7
730 [CDP7.1.7]Oozie job에서 ERROR: Kudu error(s) reported, first error: Timed out: Failed to write batch of 774 ops to tablet 8003f9a064bf4be5890a178439b2ba91가 발생하면서 쿼리가 실패하는 경우 gooper 2024.01.05 7
729 eclipse editor 설정방법 총관리자 2022.02.01 9
728 주문히스토리 조회 총관리자 2022.04.30 10
727 [bitbucket] 2022년 3월 2일 부터 git 작업시 기존에 사용하던 비빌번호를 사용할 수 없도록 변경되었다. 총관리자 2022.04.30 10
726 oozie의 sqoop action수행시 ooize:launcher의 applicationId를 이용하여 oozie:action의 applicationId및 관련 로그를 찾는 방법 gooper 2023.07.26 10
725 주문 생성 데이터 예시 총관리자 2022.04.30 11
724 [EncryptionZone]User:testuser not allowed to do "DECRYPT_EEK" on 'testkey' gooper 2023.06.29 11
723 [CDP7.1.7]Encryption Zone내부/외부 간 데이터 이동(mv,cp)및 CTAS, INSERT SQL시 오류(can't be moved into an encryption zone, can't be moved from an encryption zone) gooper 2023.11.14 11
722 [CDP7.1.7]impala-shell수행시 간헐적으로 "-k requires a valid kerberos ticket but no valid kerberos ticket found." 오류 gooper 2023.11.16 11
721 [Encryption Zone]Encryption Zone에 생성된 table을 select할때 HDFS /tmp/zone1에 대한 권한이 없는 경우 gooper 2023.06.29 12

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로