问题:
2019-06-01 09:48:22,376 INFO [org.apache.sqoop.audit.AuditLoggerManager.initializeLoggers(AuditLoggerManager.java:121)] Audit Logger has been initialized: default 2019-06-01 09:48:22,377 INFO [org.apache.sqoop.audit.AuditLoggerManager.initialize(AuditLoggerManager.java:79)] Audit logger manager initialized: OK 2019-06-01 09:48:22,378 INFO [org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:91)] Setting system properties: {derby.stream.error.file=/home/zkkafka/sqoop2/logs/derbyrepo.log} 2019-06-01 09:48:22,384 INFO [org.apache.sqoop.repository.JdbcRepositoryContext.<init>(JdbcRepositoryContext.java:156)] [repo-ctx] handler=org.apache.sqoop.repository.derby.DerbyRepositoryHandler, conn-url=jdbc:derby:/home/zkkafka/sqoop2/basedir/repository/SQOOP;create=true, driver=org.apache.derby.jdbc.EmbeddedDriver, user=sa, password=*****, jdbc-props={}, tx-isolation=READ_COMMITTED, max-conn=10 2019-06-01 09:48:22,750 INFO [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.initialize(DerbyRepositoryHandler.java:99)] DerbyRepositoryHandler initialized. 2019-06-01 09:48:22,753 INFO [org.apache.sqoop.repository.JdbcRepositoryProvider.initializeRepositoryHandler(JdbcRepositoryProvider.java:160)] JdbcRepositoryProvider initialized 2019-06-01 09:48:22,753 INFO [org.apache.sqoop.repository.JdbcRepositoryProvider.initialize(JdbcRepositoryProvider.java:67)] JdbcRepository initialized. 2019-06-01 09:48:22,753 INFO [org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:127)] Creating or updating respository at bootup 2019-06-01 09:48:26,785 INFO [org.apache.sqoop.repository.JdbcRepository$1.doIt(JdbcRepository.java:131)] Creating repository schema objects 2019-06-01 09:48:27,149 INFO [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectRepositoryVersion(DerbyRepositoryHandler.java:191)] Can't fetch repository structure version. org.apache.commons.dbcp.SQLNestedException: Borrow prepareStatement from pool failed at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:113) at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:281) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.prepareStatement(PoolingDataSource.java:313) at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectRepositoryVersion(DerbyRepositoryHandler.java:177) at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.createOrUpgradeRepository(DerbyRepositoryHandler.java:201) at org.apache.sqoop.repository.JdbcRepository$1.doIt(JdbcRepository.java:132) at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:91) at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:62) at org.apache.sqoop.repository.JdbcRepository.createOrUpgradeRepository(JdbcRepository.java:128) at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:128) at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:82) at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:60) at org.apache.sqoop.server.SqoopJettyServer.<init>(SqoopJettyServer.java:67) at org.apache.sqoop.server.SqoopJettyServer.main(SqoopJettyServer.java:177) Caused by: java.sql.SQLSyntaxErrorException: Schema 'SQOOP' does not exist at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement.<init>(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement20.<init>(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement30.<init>(Unknown Source) at org.apache.derby.impl.jdbc.EmbedPreparedStatement40.<init>(Unknown Source) at org.apache.derby.jdbc.Driver40.newEmbedPreparedStatement(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source) at org.apache.commons.dbcp.PoolingConnection.makeObject(PoolingConnection.java:285) at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1179) at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:107) ... 13 more Caused by: java.sql.SQLException: Schema 'SQOOP' does not exist at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ... 29 more Caused by: ERROR 42Y07: Schema 'SQOOP' does not exist at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) at org.apache.derby.impl.sql.catalog.DataDictionaryImpl.getSchemaDescriptor(Unknown Source) at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source) at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source) at org.apache.derby.impl.sql.compile.FromBaseTable.bindTableDescriptor(Unknown Source) at org.apache.derby.impl.sql.compile.FromBaseTable.bindNonVTITables(Unknown Source) at org.apache.derby.impl.sql.compile.FromList.bindTables(Unknown Source) at org.apache.derby.impl.sql.compile.SelectNode.bindNonVTITables(Unknown Source) at org.apache.derby.impl.sql.compile.DMLStatementNode.bindTables(Unknown Source) at org.apache.derby.impl.sql.compile.DMLStatementNode.bind(Unknown Source) at org.apache.derby.impl.sql.compile.CursorNode.bindStatement(Unknown Source) at org.apache.derby.impl.sql.GenericStatement.prepMinion(Unknown Source) at org.apache.derby.impl.sql.GenericStatement.prepare(Unknown Source) at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.prepareInternalStatement(Unknown Source) ... 23 more 2019-06-01 09:48:27,165 INFO [org.apache.sqoop.repository.common.CommonRepositoryHandler.runQuery(CommonRepositoryHandler.java:2682)] QUERY(CREATE SCHEMA "SQOOP") Update count: 0 2019-06-01 09:48:27,276 INFO [org.apache.sqoop.repository.common.CommonRepositoryHandler.runQuery(CommonRepositoryHandler.java:2682)] QUERY(CREATE TABLE "SQOOP"."SQ_CONNECTOR" ("SQC_ID" BIGINT GENERATED ALWAYS AS IDENTITY (START WITH 1, INCREMENT BY 1) PRIMARY KEY, "SQC_NAME" VARCHAR(64), "SQC_CLASS" VARCHAR(255), "SQC_VERSION" VARCHAR(64) )) Update count: 0 2019-06-01 09:48:27,403 INFO [org.apache.sqoop.repository.common.CommonRepositoryHandler.runQuery(CommonRepositoryHandler.java:2682)] QUERY(CREATE TABLE "SQOOP"."SQ_FORM" ("SQF_ID" BIGINT GENERATED ALWAYS AS IDENTITY (START WITH 1, INCREMENT BY 1) PRIMARY KEY, "SQF_CONNECTOR" BIGINT, "SQF_OPERATION" VARCHAR(32), "SQF_NAME" VARCHAR(64), "SQF_TYPE" VARCHAR(32), "SQF_INDEX" SMALLINT, CONSTRAINT "SQOOP"."FK_SQF_SQC" FOREIGN KEY (
sqoop2 创建的derby第一次链接是没有数据库 SQOOP的,然后自动创建 SQOOP数据库,并赋值元数据
捐助开发者
在兴趣的驱动下,写一个免费
的东西,有欣喜,也还有汗水,希望你喜欢我的作品,同时也能支持一下。 当然,有钱捧个钱场(支持支付宝和微信 以及扣扣群),没钱捧个人场,谢谢各位。
个人主页:http://knight-black-bob.iteye.com/
谢谢您的赞助,我会做的更好!
相关推荐
Warning: /opt/module/sqoop/bin/…/…/hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /opt/module/sqoop/bin/…/…/accumulo ...
sqoop2安装包。
sqoop2安装文档,这个很全面,每一步都有,希望对你有所帮助
sqoop2-1.99.7 documentation 英文文档
使用sqoop2从mysql导入hadoop时,导入的数据带单引号。是由于sqoop2的一个bug导致,该包上传到sqoop_home/server/lib替换原来的jar包后,重启sqoop server,即可解决。
利用sqoop导出DB2的数据时所需的驱动包,只需要将该包放到hive或sqoop的lib目录下即可。
很好用,sqoop2,希望能帮助到你,Sqoop是一个用来将Hadoop和关系型数据库中的数据相互转移的工具
sqoop安装详解以及sqoop内容介绍使用介绍 集群介绍 sqoop:是一个工具,主要用于导入导出,实现MySQL到Hadoop之间数据的转换 2、导入数据:从结构化数据(Mysql,oracle,db2,)导入到半结构化或非结构化hadoop中...
说明: 版本为:sqoop2-1.99.5-cdh5.10.2 解决数据分隔符 以及 string类型数据存在单引号问题(解决方式 通过更改源码SqoopIDFUtils 里面的分隔符来解决此问题 ) 只需要将以下包进行替换 connector-sdk-1.99.5-...
sqoop 导入数据时候报错ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: oracle.jdbc.OracleDriver 缺少驱动包。
sqoop框架开发工具使用的jar,目前版本有1.4.6和1.4.7两个jar包,启动Sqoop时,抛出异常:Error: Could not find or load main class .usr.local.sqoop-1.4.7.sqoop-1.4.7.jar 则可以下载资源将sqoop-1.4.7.jar放到...
运行Sqoop报错:找不到或无法加载主类 org.apache.sqoop.sqoop 将sqoop-1.4.7.jar包放到Sqoop的lib目录下,问题解决。
sqoop连接sqlserver的驱动工具,没有这个sqoop是连不上滴
Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.Sqoop集群搭建.
07_Sqoop中的增量导入与Sqoop job 08_Sqoop将MySQL数据导入Hive表中 09_Sqoop的导出及脚本中使用的方式 10_案例分析-动态分区的实现 11_案例分析-源表的分区加载创建 12_案例分析-指标分析使用Sqoop导出
sqoop-1.4.6.jar,sqoop报错找不到加载类的时候 将该文件放入sqoop的lib文件夹下
Sqoop即 SQL to Hadoop ,是一款方便的在传统型数据库与Hadoop之间进行数据迁移的工具,充分利用MapReduce并行特点以批处理的方式加快数据传输
sqoop学习文档(2){Sqoop import、Sqoop export}。记录我的学习之旅,每份文档倾心倾力,带我成我大牛,回头观望满脸笑意,望大家多多给予意见,有问题或错误,请联系 我将及时改正;借鉴文章标明出处,谢谢
sqoop的常用指令操作
2、配置sqoop的环境配置文件: mv /usr/local/sqoop-1.4.6-cdh5.13.2/conf/sqoop-env.template.sh /usr/local/sqoop-1.4.6-cdh5.13.2/conf/sqoop-env.sh vi /usr/local/sqoop-1.4.6-cdh5.13.2/conf/sqoop-env.sh ...