메뉴 건너뛰기

Bigdata, Semantic IoT, Hadoop, NoSQL

Bigdata, Hadoop ecosystem, Semantic IoT등의 프로젝트를 진행중에 습득한 내용을 정리하는 곳입니다.
필요한 분을 위해서 공개하고 있습니다. 문의사항은 gooper@gooper.com로 메일을 보내주세요.


Jena 2.3를 Hadoop 2.7.2의  NFS로 mount하고 fuseki를 이용하여 start할때 오류 메세지이며
hadoop nfs에서 setattr을 지원하지 않아서 발생하는 오류임

--------------------------------------fuseki에서 발생하는 오류 메세지------------
-bash-4.1$ cat nohup.out 
FUSEKI_BASE : /svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Server     INFO  Fuseki 2.3.0 2015-07-25T17:11:28+0000
[2016-11-25 15:44:12] Config     INFO  FUSEKI_HOME=/svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Config     INFO  FUSEKI_BASE=/svc/apps/sda/bin/apache-jena-fuseki-2.3.0
[2016-11-25 15:44:12] Servlet    INFO  Initializing Shiro environment
[2016-11-25 15:44:12] Config     INFO  Shiro file: file:///svc/apps/sda/bin/apache-jena-fuseki-2.3.0/shiro.ini
[2016-11-25 15:44:12] Config     INFO  Template file: templates/config-tdb-dir
[2016-11-25 15:44:12] Config     INFO  TDB dataset: directory=/svc/apps/sda/bin/fuseki/mydb
[2016-11-25 15:44:12] Server     ERROR Exception in initialization: caught: BlockMgrMapped.segmentAllocate: Segment = 0
[2016-11-25 15:44:12] WebAppContext WARN  Failed startup of context o.e.j.w.WebAppContext@7dd712e8{/,file:/home/hadoop/svc/apps/sda/bin/apache-jena-fuseki-2.3.0/webapp/,STARTING}
org.apache.jena.assembler.exceptions.AssemblerException: caught: BlockMgrMapped.segmentAllocate: Segment = 0
  doing:
    root: file:///icbms#tdb_dataset_readwrite with type: http://jena.hpl.hp.com/2008/tdb#DatasetTDB assembler class: class org.apache.jena.tdb.assembler.DatasetAssemblerTDB

        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.openBySpecificType(AssemblerGroup.java:138)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.open(AssemblerGroup.java:117)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$ExpandingAssemblerGroup.open(AssemblerGroup.java:81)
        at org.apache.jena.assembler.assemblers.AssemblerBase.open(AssemblerBase.java:37)
        at org.apache.jena.assembler.assemblers.AssemblerBase.open(AssemblerBase.java:33)
        at org.apache.jena.fuseki.build.Builder.buildDataService(Builder.java:74)
        at org.apache.jena.fuseki.build.Builder.buildDataAccessPoint(Builder.java:59)
        at org.apache.jena.fuseki.server.FusekiServer.configFromTemplate(FusekiServer.java:315)
        at org.apache.jena.fuseki.server.FusekiServer.initServerConfiguration(FusekiServer.java:263)
        at org.apache.jena.fuseki.server.FusekiServer.initializeDataAccessPoints(FusekiServer.java:211)
        at org.apache.jena.fuseki.server.FusekiServerListener.init(FusekiServerListener.java:71)
        at org.apache.jena.fuseki.server.FusekiServerListener.contextInitialized(FusekiServerListener.java:45)
        at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:799)
        at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:446)
        at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:296)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1347)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:743)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:492)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:117)
        at org.eclipse.jetty.server.Server.start(Server.java:355)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:99)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:60)
        at org.eclipse.jetty.server.Server.doStart(Server.java:324)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.jena.fuseki.jetty.JettyFuseki.start(JettyFuseki.java:120)
        at org.apache.jena.fuseki.cmd.FusekiCmd$FusekiCmdInner.exec(FusekiCmd.java:336)
        at jena.cmd.CmdMain.mainMethod(CmdMain.java:93)
        at jena.cmd.CmdMain.mainRun(CmdMain.java:58)
        at jena.cmd.CmdMain.mainRun(CmdMain.java:45)
        at org.apache.jena.fuseki.cmd.FusekiCmd$FusekiCmdInner.innerMain(FusekiCmd.java:96)
        at org.apache.jena.fuseki.cmd.FusekiCmd.main(FusekiCmd.java:59)
Caused by: org.apache.jena.tdb.base.file.FileException: BlockMgrMapped.segmentAllocate: Segment = 0
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocSegment(BlockAccessMapped.java:231)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.getByteBuffer(BlockAccessMapped.java:157)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocate(BlockAccessMapped.java:85)
        at org.apache.jena.tdb.base.block.BlockMgrFileAccess.allocate(BlockMgrFileAccess.java:50)
        at org.apache.jena.tdb.base.block.BlockMgrBase.allocate(BlockMgrBase.java:44)
        at org.apache.jena.tdb.base.block.BlockMgrWrapper.allocate(BlockMgrWrapper.java:46)
        at org.apache.jena.tdb.base.block.BlockMgrFreeChain.allocate(BlockMgrFreeChain.java:48)
        at org.apache.jena.tdb.base.page.PageBlockMgr.create(PageBlockMgr.java:51)
        at org.apache.jena.tdb.index.bplustree.BPTreeRecordsMgr.create(BPTreeRecordsMgr.java:79)
        at org.apache.jena.tdb.index.bplustree.BPTreeNodeMgr.createEmptyBPT(BPTreeNodeMgr.java:52)
        at org.apache.jena.tdb.index.bplustree.BPlusTree.createIfAbsent(BPlusTree.java:213)
        at org.apache.jena.tdb.index.bplustree.BPlusTree.create(BPlusTree.java:139)
        at org.apache.jena.tdb.index.BuilderStdIndex$RangeIndexBuilderStd.createBPTree(BuilderStdIndex.java:94)
        at org.apache.jena.tdb.index.BuilderStdIndex$RangeIndexBuilderStd.buildRangeIndex(BuilderStdIndex.java:65)
        at org.apache.jena.tdb.index.BuilderStdIndex$IndexBuilderStd.buildIndex(BuilderStdIndex.java:47)
        at org.apache.jena.tdb.setup.BuilderStdDB$NodeTableBuilderStd.buildNodeTable(BuilderStdDB.java:72)
        at org.apache.jena.tdb.setup.DatasetBuilderStd$NodeTableBuilderRecorder.buildNodeTable(DatasetBuilderStd.java:423)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.makeNodeTable(DatasetBuilderStd.java:323)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.buildWorker(DatasetBuilderStd.java:204)
        at org.apache.jena.tdb.setup.DatasetBuilderStd._build(DatasetBuilderStd.java:198)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.build(DatasetBuilderStd.java:187)
        at org.apache.jena.tdb.setup.DatasetBuilderStd.create(DatasetBuilderStd.java:91)
        at org.apache.jena.tdb.StoreConnection.make(StoreConnection.java:228)
        at org.apache.jena.tdb.StoreConnection.make(StoreConnection.java:235)
        at org.apache.jena.tdb.transaction.DatasetGraphTransaction.<init>(DatasetGraphTransaction.java:73)
        at org.apache.jena.tdb.sys.TDBMaker._create(TDBMaker.java:58)
        at org.apache.jena.tdb.sys.TDBMaker.createDatasetGraphTransaction(TDBMaker.java:46)
        at org.apache.jena.tdb.TDBFactory._createDatasetGraph(TDBFactory.java:82)
        at org.apache.jena.tdb.TDBFactory.createDatasetGraph(TDBFactory.java:64)
        at org.apache.jena.tdb.assembler.DatasetAssemblerTDB.make(DatasetAssemblerTDB.java:57)
        at org.apache.jena.tdb.assembler.DatasetAssemblerTDB.createDataset(DatasetAssemblerTDB.java:48)
        at org.apache.jena.sparql.core.assembler.DatasetAssembler.open(DatasetAssembler.java:45)
        at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.openBySpecificType(AssemblerGroup.java:130)
        ... 32 more
Caused by: java.io.IOException: 부적절한 인수
        at sun.nio.ch.FileDispatcherImpl.truncate0(Native Method)
        at sun.nio.ch.FileDispatcherImpl.truncate(FileDispatcherImpl.java:80)
        at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:905)
        at org.apache.jena.tdb.base.file.BlockAccessMapped.allocSegment(BlockAccessMapped.java:223)
        ... 64 more
[2016-11-25 15:44:12] Server     INFO  Started 2016/11/25 15:44:12 KST on port 23030



----------------------------------------hadoop nfs에서 발생하는 메세지-----------------------------------------------
-bash-4.1# 16/11/25 17:59:49 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:50 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:51 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:52 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:53 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:54 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:55 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:55 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:56 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:57 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:58 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 17:59:59 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:00 ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when setattr, fileId: 1128904
16/11/25 18:00:01 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:02 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:03 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:04 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:05 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:06 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:07 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:08 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:09 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-1710818332
16/11/25 18:00:10 INFO security.ShellBasedIdMapping: Can't map group supergroup. Use its string hashcode:-17108183
번호 제목 글쓴이 날짜 조회 수
79 federated query 예제 총관리자 2017.01.19 31
78 fuseki에서 제공하는 script중 s-post를 사용하는 예문 총관리자 2017.09.15 34
77 ServerInfo객체파일 총관리자 2016.07.21 35
76 S2RDF모듈의 실행부분만 추출하여 별도록 실행하는 방법(draft) 총관리자 2016.06.14 36
75 5건의 triple data를 이용하여 특정 작업 폴더에서 작업하는 방법/절차 총관리자 2016.06.16 36
74 DeviceType이 o:motion-sensor_33 이거나 o:motion-sensor_32 경우의 sparql문장은 다음과 같다. 총관리자 2017.08.16 40
73 커리 변경 이벤트를 처리하기 위한 구현클래스 총관리자 2016.07.21 41
72 RDF4J의 rdf4j-server.war가 제공하는 RESTFul API를 이용한 CRUD테스트(트랜잭션처리) 총관리자 2017.08.30 43
71 python실행시 ValueError: zero length field name in format오류 해결방법 총관리자 2016.05.27 44
70 halyard의 console스크립트에서 생성한 repository는 RDF4J Web Applications에서 공유가 되지 않는다. 총관리자 2017.07.05 45
69 워킹 메모리에 대한 정보를 처리하는 클래스 파일 총관리자 2016.07.21 49
68 [oneM2M]Ontologies used for oneM2M 총관리자 2017.08.02 49
67 RDF4J의 rdf4j-server.war가 제공하는 RESTFul API를 이용하여 repository에 CRUD테스트 총관리자 2017.08.30 51
66 S2RDF를 이용한 다른 버젼의 github링크 총관리자 2016.12.02 51
65 DataSetCreator.py 실행시 파일을 찾을 수 없는 오류 총관리자 2016.05.27 53
64 fuseki가 제공하는 web ui를 통해서 dataset를 remove->create할 경우 동일한 동일한 이름으로 지정했을때 fuseki-server.jar가 뜨지 않는 현상 총관리자 2017.02.03 54
63 9대가 hbase cluster로 구성된 서버에서 테스트 data를 halyard에 적재하고 테스트 하는 방법및 절차 총관리자 2017.07.21 56
62 queryTranslator실행시 NullPointerException가 발생전에 java.lang.ArrayIndexOutOfBoundsException발생시 조치사항 총관리자 2016.06.16 58
61 데이타 분석및 머신러닝에 도움이 도움이 되는 사이트 총관리자 2016.11.04 64
60 halyard 1.3의 rdf4j-server.war와 rdf4j-workbench.war를 tomcat deploy후 조회시 java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/Cell발생시 조치사항 총관리자 2017.07.05 65

A personal place to organize information learned during the development of such Hadoop, Hive, Hbase, Semantic IoT, etc.
We are open to the required minutes. Please send inquiries to gooper@gooper.com.

위로