메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


jena의 data폴더를 hadoop nfs를 이용하여 HDFS상의 폴더에 마운트 시키고 fuseki를 통하여 insert를 시도했을때 아래와 같은 오류가 발생한다.


--------------------------------오류내용-----------------------------
[2016-11-30 15:12:57,072] [sf.SparqlService] [runModifySparql(#497)] [DEBUG] Exception message in runModifySparql() =====> 500 - Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) 


[2016-11-30 15:12:57] TDB        WARN  Exception during 'abort'
org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     WARN  [31076] RC = 500 : Exception during abort - transaction did abort
org.apache.jena.tdb.transaction.TDBTransactionException: Exception during abort - transaction did abort
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:199)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        ... 45 more
[2016-11-30 15:12:57] Fuseki     INFO  [31076] 500 Exception during abort - transaction did abort (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST http://XXX.XXX.XXX.XXX:23030/icbms
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST /icbms :: '' :: [application/x-www-form-urlencoded charset=UTF-8] ? 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] Query = PREFIX  p1:   <http://purl.org/dc/elements/1.1/#> PREFIX  qudt: <http://data.nasa.gov/qudt/owl/qudt#> PREFIX  owl:  <http://www.w3.org/2002/07/owl#> PREFIX  swrlb: <http://www.w3.org/2003/11/swrlb#> PREFIX  xsd:  <http://www.w3.org/2001/XMLSchema#> PREFIX  skos: <http://www.w3.org/2004/02/skos/core#> PREFIX  dim:  <http://data.nasa.gov/qudt/owl/dimension#> PREFIX  rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX  ssn:  <http://purl.oclc.org/NET/ssnx/ssn#> PREFIX  dct:  <http://purl.org/dc/terms/> PREFIX  xsp:  <http://www.owl-ontologies.com/2005/08/07/xsp.owl#> PREFIX  foaf: <http://xmlns.com/foaf/0.1/> PREFIX  cc:   <http://creativecommons.org/ns#> PREFIX  b:    <http://www.onem2m.org/ontology/Base_Ontology#> PREFIX  quantity: <http://data.nasa.gov/qudt/owl/quantity> PREFIX  protege: <http://protege.stanford.edu/plugins/owl/protege#> PREFIX  swrl: <http://www.w3.org/2003/11/swrl#> PREFIX  herit: <http://herit-in/herit-cse/> PREFIX  j.0:  <http://data.qudt.org/qudt/owl/1.0.0/text/> PREFIX  o:    <http://www.iotoasis.org/ontology/> PREFIX  unit: <http://data.nasa.gov/qudt/owl/unit#> PREFIX  rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX  dul:  <http://www.loa-cnr.it/ontologies/DUL.owl#> PREFIX  dc:   <http://purl.org/dc/elements/1.1/>  SELECT  ?loc (if(( ?val < 7 ), o:sunny, o:cloudy) AS ?cond) WHERE   { ?AE       o:hasResource         ?con1 ;               rdf:type              b:Device ;               dul:hasLocation       ?loc ;               o:hasDeviceType       o:temperaturehumidityweatherSensor_7 ;               b:hasFunctionality    ?function .     ?con1     o:hasResource         ?con2 .     ?con2     o:hasLatestContentInstance  ?ci .     ?ci       o:hasContentValue     ?val ;               o:isContentInstanceOf  ?con2 .     ?function  rdf:type             o:MeasureFunctionality ;               b:refersTo            o:weather-aspect   } LIMIT   100 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] exec/select
[2016-11-30 15:12:57] Fuseki     INFO  [31077] 200 OK (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:12:57] Fuseki     WARN  [31078] RC = 500 : Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
org.apache.jena.sparql.JenaTransactionException: Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction.checkNotActive(DatasetGraphTransaction.java:120)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.begin(DatasetGraphTrackActive.java:41)
        at org.apache.jena.fuseki.servlets.HttpAction.beginWrite(HttpAction.java:275)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.execute(SPARQL_Update.java:216)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.executeBody(SPARQL_Update.java:180)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.perform(SPARQL_Update.java:101)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.serviceDispatch(SPARQL_UberServlet.java:294)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:256)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] 500 Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) (0 ms)
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:13:04] Fuseki     INFO  [31062] exec/select
번호 제목 글쓴이 날짜 조회 수
13 fuseki에서 제공하는 script중 s-post를 사용하는 예문 총관리자 2017.09.15 34
12 jena/fuseki 3.4.0 설치 총관리자 2017.07.25 170
11 fuseki용 config-examples.ttl 예시 내용 총관리자 2017.05.17 646
10 fuseki webUI를 통해서 전체 카운트를 하면 급격하게 메모리를 소모해 버리는 문제가 있음 file 총관리자 2017.04.28 162
9 update를 많이 하면 heap memory가 많이 소진되고 최종적으로 OOM가 발생하는데 이에 대한 설명 총관리자 2017.04.10 717
8 fuseki가 제공하는 web ui를 통해서 dataset를 remove->create할 경우 동일한 동일한 이름으로 지정했을때 fuseki-server.jar가 뜨지 않는 현상 총관리자 2017.02.03 54
» jena의 data폴더를 hadoop nfs를 이용하여 HDFS상의 폴더에 마운트 시키고 fuseki를 통하여 inert를 시도했을때 transaction 오류 발생 총관리자 2016.12.02 82
6 Jena 2.3를 Hadoop 2.7.2의 NFS로 mount하고 fuseki를 이용하여 start할때 오류 메세지 총관리자 2016.12.02 1557
5 동시에 많은 요청이 endpoint로 몰려서java.net.NoRouteToHostException가 발생하는 경우의 처리방법 총관리자 2016.10.17 508
4 jena jar파일실행시 org.apache.jena.tdb.TDB.init에서 java.lang.NullPointerException발생시 조치사항 총관리자 2016.08.19 134
3 Jena는 기본적으로 multi thread환경을 지원하지 않는다. 총관리자 2016.08.16 94
2 [Elephas] Jena Elephas를 이용하여 Spark에서 rdfTriples의 RDD를 만들고 RDD관련 작업하는 샘플소스 총관리자 2016.08.10 90
1 select와 group by결과 값이 없는경우의 리턴 값이 다름 file 총관리자 2016.02.05 119

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로