700字范文,内容丰富有趣,生活中的好帮手!
700字范文 > sqoop mysql 乱码_请问一下 用sqoop导数据到mysql如果遇到字段编码是utf8mb4的情况怎么处理?...

sqoop mysql 乱码_请问一下 用sqoop导数据到mysql如果遇到字段编码是utf8mb4的情况怎么处理?...

时间:2023-10-07 18:09:44

相关推荐

sqoop mysql 乱码_请问一下 用sqoop导数据到mysql如果遇到字段编码是utf8mb4的情况怎么处理?...

我要到的数据其中一个字段里应该是有表情符号,之前数据库的处理是把,字段编码修改成utf8mb4.但现在用sqoop导数据到mysql(对应字段已修改为utf8mb4),却报了如下错误。

谢谢。

15/06/02 17:47:49 INFO mapred.JobClient: Task Id : attempt_05131108_23771_m_000000_2, Status : FAILED

java.io.IOException: Can’t export data, please check failed map task logs

at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)

at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)

at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)

at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)

at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)

at org.apache.hadoop.mapred.Child.main(Child.java:249)

Caused by: java.io.IOException: java.sql.SQLException: Incorrect string value: ‘\xF0\x9F\x91\x91\xE5\xB0…’ for column ‘customer_name’ at row 39

at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)

at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:46)

at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:638)

at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)

at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84)

… 10 more

Caused by: java.sql.SQLException: Incorrect string value: ‘\xF0\x9F\x91\x91\xE5\xB0…’ for column ‘customer_name’ at row 39

at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1094)

at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4208)

at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4140)

at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2597)

at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2758)

at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2826)

at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2082)

at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:1302)

at org.apache.sqoop.mapreduce.AsyncSqlOutputFormat$AsyncSqlExecThread.run(AsyncSqlOutputFormat.java:233)

本内容不代表本网观点和政治立场,如有侵犯你的权益请联系我们处理。
网友评论
网友评论仅供其表达个人看法,并不表明网站立场。