메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


jena의 data폴더를 hadoop nfs를 이용하여 HDFS상의 폴더에 마운트 시키고 fuseki를 통하여 insert를 시도했을때 아래와 같은 오류가 발생한다.


--------------------------------오류내용-----------------------------
[2016-11-30 15:12:57,072] [sf.SparqlService] [runModifySparql(#497)] [DEBUG] Exception message in runModifySparql() =====> 500 - Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) 


[2016-11-30 15:12:57] TDB        WARN  Exception during 'abort'
org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     WARN  [31076] RC = 500 : Exception during abort - transaction did abort
org.apache.jena.tdb.transaction.TDBTransactionException: Exception during abort - transaction did abort
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:199)
        at org.apache.jena.tdb.transaction.Transaction.close(Transaction.java:238)
        at org.apache.jena.tdb.transaction.DatasetGraphTxn.end(DatasetGraphTxn.java:63)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction._end(DatasetGraphTransaction.java:174)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.end(DatasetGraphTrackActive.java:64)
        at org.apache.jena.fuseki.servlets.HttpAction.endRead(HttpAction.java:270)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.execute(SPARQL_Query.java:267)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.executeWithParameter(SPARQL_Query.java:212)
        at org.apache.jena.fuseki.servlets.SPARQL_Query.perform(SPARQL_Query.java:108)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:226)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.jena.tdb.transaction.TDBTransactionException: Txn[30897]/W: Not in a transaction for a commit to happen
        at org.apache.jena.tdb.transaction.NodeTableTrans.abort(NodeTableTrans.java:342)
        at org.apache.jena.tdb.transaction.Transaction.abort(Transaction.java:191)
        ... 45 more
[2016-11-30 15:12:57] Fuseki     INFO  [31076] 500 Exception during abort - transaction did abort (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST http://XXX.XXX.XXX.XXX:23030/icbms
[2016-11-30 15:12:57] Fuseki     INFO  [31077] POST /icbms :: '' :: [application/x-www-form-urlencoded charset=UTF-8] ? 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] Query = PREFIX  p1:   <http://purl.org/dc/elements/1.1/#> PREFIX  qudt: <http://data.nasa.gov/qudt/owl/qudt#> PREFIX  owl:  <http://www.w3.org/2002/07/owl#> PREFIX  swrlb: <http://www.w3.org/2003/11/swrlb#> PREFIX  xsd:  <http://www.w3.org/2001/XMLSchema#> PREFIX  skos: <http://www.w3.org/2004/02/skos/core#> PREFIX  dim:  <http://data.nasa.gov/qudt/owl/dimension#> PREFIX  rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX  ssn:  <http://purl.oclc.org/NET/ssnx/ssn#> PREFIX  dct:  <http://purl.org/dc/terms/> PREFIX  xsp:  <http://www.owl-ontologies.com/2005/08/07/xsp.owl#> PREFIX  foaf: <http://xmlns.com/foaf/0.1/> PREFIX  cc:   <http://creativecommons.org/ns#> PREFIX  b:    <http://www.onem2m.org/ontology/Base_Ontology#> PREFIX  quantity: <http://data.nasa.gov/qudt/owl/quantity> PREFIX  protege: <http://protege.stanford.edu/plugins/owl/protege#> PREFIX  swrl: <http://www.w3.org/2003/11/swrl#> PREFIX  herit: <http://herit-in/herit-cse/> PREFIX  j.0:  <http://data.qudt.org/qudt/owl/1.0.0/text/> PREFIX  o:    <http://www.iotoasis.org/ontology/> PREFIX  unit: <http://data.nasa.gov/qudt/owl/unit#> PREFIX  rdf:  <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX  dul:  <http://www.loa-cnr.it/ontologies/DUL.owl#> PREFIX  dc:   <http://purl.org/dc/elements/1.1/>  SELECT  ?loc (if(( ?val < 7 ), o:sunny, o:cloudy) AS ?cond) WHERE   { ?AE       o:hasResource         ?con1 ;               rdf:type              b:Device ;               dul:hasLocation       ?loc ;               o:hasDeviceType       o:temperaturehumidityweatherSensor_7 ;               b:hasFunctionality    ?function .     ?con1     o:hasResource         ?con2 .     ?con2     o:hasLatestContentInstance  ?ci .     ?ci       o:hasContentValue     ?val ;               o:isContentInstanceOf  ?con2 .     ?function  rdf:type             o:MeasureFunctionality ;               b:refersTo            o:weather-aspect   } LIMIT   100 
[2016-11-30 15:12:57] Fuseki     INFO  [31077] exec/select
[2016-11-30 15:12:57] Fuseki     INFO  [31077] 200 OK (2 ms)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:12:57] Fuseki     INFO  [31078] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:12:57] Fuseki     WARN  [31078] RC = 500 : Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
org.apache.jena.sparql.JenaTransactionException: Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction.checkNotActive(DatasetGraphTransaction.java:120)
        at org.apache.jena.sparql.core.DatasetGraphTrackActive.begin(DatasetGraphTrackActive.java:41)
        at org.apache.jena.fuseki.servlets.HttpAction.beginWrite(HttpAction.java:275)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.execute(SPARQL_Update.java:216)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.executeBody(SPARQL_Update.java:180)
        at org.apache.jena.fuseki.servlets.SPARQL_Update.perform(SPARQL_Update.java:101)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.executeLifecycle(ActionSPARQL.java:132)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeRequest(SPARQL_UberServlet.java:330)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.serviceDispatch(SPARQL_UberServlet.java:294)
        at org.apache.jena.fuseki.servlets.SPARQL_UberServlet.executeAction(SPARQL_UberServlet.java:256)
        at org.apache.jena.fuseki.servlets.ActionSPARQL.execCommonWorker(ActionSPARQL.java:83)
        at org.apache.jena.fuseki.servlets.ActionBase.doCommon(ActionBase.java:79)
        at org.apache.jena.fuseki.servlets.FusekiFilter.doFilter(FusekiFilter.java:71)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1632)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
        at org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
        at org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:449)
        at org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
        at org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
        at org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
        at org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:383)
        at org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
        at org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1624)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:568)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1110)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:479)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1044)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:459)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:281)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:232)
        at org.eclipse.jetty.io.AbstractConnection$1.run(AbstractConnection.java:505)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:607)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:536)
        at java.lang.Thread.run(Thread.java:745)
[2016-11-30 15:12:57] Fuseki     INFO  [31078] 500 Currently in a transaction (location:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/mydb/) (0 ms)
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST http://XXX.XXX.XXX.XXX:23030/icbms/update
[2016-11-30 15:13:02] Fuseki     INFO  [31079] POST /icbms :: 'update' :: [application/sparql-update] ? 
[2016-11-30 15:13:04] Fuseki     INFO  [31062] exec/select
번호 제목 글쓴이 날짜 조회 수
59 cumulusRDF 1.0.1설치및 "KeyspaceCumulus" keyspace확인하기 file 총관리자 2016.04.15 242
58 프로그래밍 언어별 딥러닝 라이브러리 정리 file 총관리자 2016.10.05 215
57 숭실대 교수님등 강의영상(바이오데이터마이닝, 빅데이터분산컴퓨팅, 컴퓨터 그래픽스, 데이터베이스응용및 프로그램밍, 데이터베이스, 의생명영상처리, 웹그로그래밍, 데이터마이닝, 컴퓨터구조) file 총관리자 2017.06.13 205
56 모두를 위한 머신러닝과 딥러닝의 강의 file 총관리자 2016.09.27 192
55 drools를 이용한 로그,rule matching등의 테스트 java프로그램 file 총관리자 2016.07.21 181
54 문자열을 숫자(integer)로 casting하기 총관리자 2016.01.13 175
53 jena/fuseki 3.4.0 설치 총관리자 2017.07.25 170
52 fuseki webUI를 통해서 전체 카운트를 하면 급격하게 메모리를 소모해 버리는 문제가 있음 file 총관리자 2017.04.28 162
51 sparql에서 concat에제 총관리자 2015.11.27 161
50 null 혹은 ""를 체크하는 방법 총관리자 2016.01.27 160
49 solrdf초기 기동시 "Caused by: java.lang.IllegalAccessError: tried to access field org.apache.solr.handler.RequestHandlerBase.log from class org.gazzax.labs.solrdf.handler.update.RdfUpdateRequestHandler" 오류가 발생시 조치사항 총관리자 2016.04.22 157
48 RDF4J의 RESTFul API처리 클래스 소스 파악(web module위주) 총관리자 2017.08.30 156
47 test2 총관리자 2017.05.01 153
46 update(update와 delete->insert)사용시 주의/참고사항 총관리자 2016.01.06 146
45 LUBM 데이타 생성구문 총관리자 2017.07.24 143
44 LUBM 개수별 hadoop HDFS data사이즈 정리 총관리자 2017.04.06 142
43 --master yarn 옵션으로 spark client프로그램 실행할때 메모리 부족 오류발생시 조치방법 총관리자 2016.05.27 141
42 한번에 여러값 update하기 총관리자 2016.01.13 134
41 jena jar파일실행시 org.apache.jena.tdb.TDB.init에서 java.lang.NullPointerException발생시 조치사항 총관리자 2016.08.19 134
40 halyard 1.3의 console을 이용하여 100억건의 데이타에 대한 쿼리수행시 ScannerTimeoutException 발생시 조치사항 총관리자 2017.09.06 134

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로