CCF 201612-3 权限查询 Java

问题描述

‍  授权 (authorization) 是各类业务系统不可缺少的组成部分,系统用户通过授权机制获得系统中各个模块的操作权限。
  本题中的授权机制是这样设计的:每位用户具有若干角色,每种角色具有若干权限。例如,用户 david 具有 manager 角色,manager 角色有 crm:2 权限,则用户 david 具有 crm:2 权限,也就是 crm 类权限的第 2 等级的权限。
  具体地,用户名和角色名称都是由小写字母组成的字符串,长度不超过 32。权限分为分等级权限和不分等级权限两大类。分等级权限由权限类名和权限等级构成,中间用冒号“:”分隔。其中权限类名也是由小写字母组成的字符串,长度不超过 32。权限等级是一位数字,从 0 到 9,数字越大表示权限等级越高。系统规定如果用户具有某类某一等级的权限,那么他也将自动具有该类更低等级的权限。例如在上面的例子中,除 crm:2 外,用户 david 也具有 crm:1 和 crm:0 权限。不分等级权限在描述权限时只有权限类名,没有权限等级(也没有用于分隔的冒号)。
  给出系统中用户、角色和权限的描述信息,你的程序需要回答多个关于用户和权限的查询。查询可分为以下几类:
  * 不分等级权限的查询:如果权限本身是不分等级的,则查询时不指定等级,返回是否具有该权限;
  * 分等级权限的带等级查询:如果权限本身分等级,查询也带等级,则返回是否具有该类的该等级权限;
  * 分等级权限的不带等级查询:如果权限本身分等级,查询不带等级,则返回具有该类权限的等级;如果不具有该类的任何等级权限,则返回“否”。

输入格式

‍  输入第一行是一个正整数 p,表示不同的权限类别的数量。紧接着的 p 行被称为 P 段,每行一个字符串,描述各个权限。对于分等级权限,格式为<category>:<level>,其中 <category>是权限类名,<level>是该类权限的最高等级。对于不分等级权限,字符串只包含权限类名。
  接下来一行是一个正整数 r,表示不同的角色数量。紧接着的 r 行被称为 R 段,每行描述一种角色,格式为
  <role> <s> <privilege 1> <privilege 2> ... <privilege s>
  其中 <role> 是角色名称,<s> 表示该角色具有多少种权限。后面 <s> 个字符串描述该角色具有的权限,格式同 P 段。
  接下来一行是一个正整数 u,表示用户数量。紧接着的 u 行被称为 U 段,每行描述一个用户,格式为
  <user> <t> <role 1> <role 2> ... <role t>
  其中 <user> 是用户名,<t> 表示该用户具有多少种角色。后面 <t> 个字符串描述该用户具有的角色。
  接下来一行是一个正整数 q,表示权限查询的数量。紧接着的 q 行被称为 Q 段,每行描述一个授权查询,格式为 <user> <privilege>,表示查询用户 <user>是否具有 <privilege> 权限。如果查询的权限是分等级权限,则查询中的 <privilege> 可指定等级,表示查询该用户是否具有该等级的权限;也可以不指定等级,表示查询该用户具有该权限的等级。对于不分等级权限,只能查询该用户是否具有该权限,查询中不能指定等级。

输出格式

‍  输出共 q 行,每行为 false、true,或者一个数字。false 表示相应的用户不具有相应的权限,true 表示相应的用户具有相应的权限。对于分等级权限的不带等级查询,如果具有权限,则结果是一个数字,表示该用户具有该权限的(最高)等级。如果用户不存在,或者查询的权限没有定义,则应该返回 false。

样例输入

‍  3
‍  crm:2
‍  git:3
‍  game
‍  4
‍  hr 1 crm:2
‍  it 3 crm:1 git:1 game
‍  dev 2 git:3 game
‍  qa 1 git:2
‍  3
‍  alice 1 hr
‍  bob 2 it qa
‍  charlie 1 dev
‍  9
‍  alice game
‍  alice crm:2
‍  alice git:0
‍  bob git
‍  bob poweroff
‍  charlie game
‍  charlie crm
‍  charlie git:3
‍  malice game

样例输出

‍  false
‍  true
‍  false
‍  2
‍  false
‍  true
‍  false
‍  true
‍  false

样例说明

‍  样例输入描述的场景中,各个用户实际的权限如下:
  * 用户 alice 具有 crm:2 权限
  * 用户 bob 具有 crm:1、git:2 和 game 权限
  * 用户 charlie 具有 git:3 和 game 权限
  * 用户 malice 未描述,因此不具有任何权限

思路说明
  • 读取角色对应的权限存放在roles
  • 读取用户对应的角色,并获取角色的所有权限,存放到users
  • 判断时,根据题目要求,先提取出用户对应的所有权限。

这里将无等级权限的最高权限用-1区分开。

import java.util.HashMap;
import java.util.Map;
import java.util.Scanner;

public class Java_201612_3 {
	public static void main(String[] args) {
		Scanner scanner = new Scanner(System.in);
		Map<String, Map<String, Integer>> roles = new HashMap<>();//<role,<privil,max>>
		Map<String, Map<String, Integer>> users = new HashMap<>();//<user,<privil,max>>
		// 获取所有权限
		int n = scanner.nextInt();
		for (int i = 0; i < n; i++) {
			scanner.next();// 没有用
		}

		// 获取所有角色
		int roles_num = scanner.nextInt();
		for (int i = 0; i < roles_num; i++) {
			String rolename = scanner.next();
			int num = Integer.parseInt(scanner.next());
			Map<String, Integer> rolemap = new HashMap<>();
			for (int j = 0; j < num; j++) {
				String string = scanner.next();
				int index = string.indexOf(":");
				String privel = string;
				int max = -1;//-1表示无等级
				if (index > 0) {
					privel = string.substring(0, index);
					max = Integer.parseInt(string.substring(index + 1));
					max = Math.max(max, rolemap.getOrDefault(privel, 0));
				}
				rolemap.put(privel, max);
			}
			roles.put(rolename, rolemap);
		}

		// 获取所有用户
		int user_num = scanner.nextInt();
		for (int i = 0; i < user_num; i++) {
			String username = scanner.next();
			int num = Integer.parseInt(scanner.next());
			Map<String, Integer> usermap = new HashMap<>();
			for (int j = 0; j < num; j++) {
				String role = scanner.next();
				Map<String, Integer> rolemap = roles.get(role);
				for (String str : rolemap.keySet()) {
					usermap.put(str, Math.max(rolemap.get(str), usermap.getOrDefault(str, 0)));
				}
			}
			users.put(username, usermap);
		}

		// 判断
		int test_num = scanner.nextInt();
		for (int i = 0; i < test_num; i++) {
			String user = scanner.next();
			String ques = scanner.next();
			Map<String, Integer> user_privileges = users.get(user);
			if (user_privileges == null) {
				System.out.println("false");
				continue;
			}
			int index = ques.indexOf(":");
			if (index > 0) {
				String privilege = ques.substring(0, index);
				int max = Integer.parseInt(ques.substring(index + 1));
				if (user_privileges.containsKey(privilege)) {
					int real_max = user_privileges.get(privilege);
					if (real_max >= max)
						System.out.println("true");
					else
						System.out.println("false");
				} else {
					System.out.println("false");
				}
			} else {
				if (user_privileges.containsKey(ques)) {
					int real_max = user_privileges.get(ques);
					if (real_max != -1)
						System.out.println(real_max);
					else
						System.out.println("true");
				} else {
					System.out.println("false");
				}
			}
		}
		scanner.close();
	}
}
sqoop import \ > --connect jdbc:mysql://localhost:3306/mydatabase \ > --username root \ > -P \ > --table products \ > --target-dir /user/hadoop/products \ > --fields-terminated-by &#39;,&#39; \ > --lines-terminated-by &#39;\n&#39; \ > --delete-target-dir \ > --num-mappers 1 Warning: /home/ljm1/daolun/servers/sqoop-1.4.6/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /home/ljm1/daolun/servers/sqoop-1.4.6/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 2025-07-05 01:36:29,069 INFO [main] sqoop.Sqoop (Sqoop.java:<init>(92)) - Running Sqoop version: 1.4.6 Enter password: 2025-07-05 01:36:35,176 INFO [main] manager.MySQLManager (MySQLManager.java:initOptionDefaults(69)) - Preparing to use a MySQL streaming resultset. 2025-07-05 01:36:35,177 INFO [main] tool.CodeGenTool (CodeGenTool.java:generateORM(92)) - Beginning code generation 2025-07-05 01:36:35,718 INFO [main] manager.SqlManager (SqlManager.java:execute(757)) - Executing SQL statement: SELECT t.* FROM `products` AS t LIMIT 1 2025-07-05 01:36:35,822 INFO [main] manager.SqlManager (SqlManager.java:execute(757)) - Executing SQL statement: SELECT t.* FROM `products` AS t LIMIT 1 2025-07-05 01:36:35,850 INFO [main] orm.CompilationManager (CompilationManager.java:findHadoopJars(94)) - HADOOP_MAPRED_HOME is /home/ljm1/daolun/servers/hadoop-2.7.4 Note: /tmp/sqoop-ljm1/compile/280c35d4ceb0b5eb13ccf7a0afe259ef/products.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 2025-07-05 01:36:42,374 INFO [main] orm.CompilationManager (CompilationManager.java:jar(330)) - Writing jar file: /tmp/sqoop-ljm1/compile/280c35d4ceb0b5eb13ccf7a0afe259ef/products.jar SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ljm1/daolun/servers/hadoop-2.7.4/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ljm1/daolun/servers/hbase-1.4.0/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2025-07-05 01:36:43,216 INFO [main] tool.ImportTool (ImportTool.java:deleteTargetDir(534)) - Destination directory /user/hadoop/products is not present, hence not deleting. 2025-07-05 01:36:43,216 WARN [main] manager.MySQLManager (MySQLManager.java:importTable(107)) - It looks like you are importing from mysql. 2025-07-05 01:36:43,217 WARN [main] manager.MySQLManager (MySQLManager.java:importTable(108)) - This transfer can be faster! Use the --direct 2025-07-05 01:36:43,217 WARN [main] manager.MySQLManager (MySQLManager.java:importTable(109)) - option to exercise a MySQL-specific fast path. 2025-07-05 01:36:43,217 INFO [main] manager.MySQLManager (MySQLManager.java:checkDateTimeBehavior(189)) - Setting zero DATETIME behavior to convertToNull (mysql) 2025-07-05 01:36:43,314 INFO [main] mapreduce.ImportJobBase (ImportJobBase.java:runImport(235)) - Beginning import of products 2025-07-05 01:36:43,375 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar 2025-07-05 01:36:43,412 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2025-07-05 01:36:43,458 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id 2025-07-05 01:36:43,462 INFO [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId= 2025-07-05 01:36:44,783 INFO [main] db.DBInputFormat (DBInputFormat.java:setTxIsolation(192)) - Using read commited transaction isolation 2025-07-05 01:36:44,854 INFO [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(198)) - number of splits:1 2025-07-05 01:36:45,148 INFO [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(287)) - Submitting tokens for job: job_local745453984_0001 2025-07-05 01:36:46,724 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605463/jackson-mapper-asl-1.9.13.jar <- /home/ljm1/jackson-mapper-asl-1.9.13.jar 2025-07-05 01:36:46,755 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/jackson-mapper-asl-1.9.13.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605463/jackson- 2025-07-05 01:36:46,793 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605464/kite-data-core-1.0.0.jar <- /home/ljm1/kite-data-core-1.0.0.jar 2025-07-05 01:36:46,798 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/kite-data-core-1.0.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605464/kite-data-cor 2025-07-05 01:36:46,798 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605465/xz-1.0.jar <- /home/ljm1/xz-1.0.jar 2025-07-05 01:36:46,801 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/xz-1.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605465/xz-1.0.jar 2025-07-05 01:36:46,801 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605466/kite-hadoop-compatibility-1.0.0.jar <- /home/ljm1/kite-hadoop-compatibility-1.0.0.j 2025-07-05 01:36:46,805 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/kite-hadoop-compatibility-1.0.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605466/ki 2025-07-05 01:36:46,805 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605467/parquet-avro-1.4.1.jar <- /home/ljm1/parquet-avro-1.4.1.jar 2025-07-05 01:36:46,810 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-avro-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605467/parquet-avro-1. 2025-07-05 01:36:46,811 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605468/sqoop-1.4.6.jar <- /home/ljm1/sqoop-1.4.6.jar 2025-07-05 01:36:46,818 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/sqoop-1.4.6.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605468/sqoop-1.4.6.jar 2025-07-05 01:36:46,818 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605469/kite-data-hive-1.0.0.jar <- /home/ljm1/kite-data-hive-1.0.0.jar 2025-07-05 01:36:46,829 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/kite-data-hive-1.0.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605469/kite-data-hiv 2025-07-05 01:36:46,829 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605470/parquet-generator-1.4.1.jar <- /home/ljm1/parquet-generator-1.4.1.jar 2025-07-05 01:36:46,833 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-generator-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605470/parquet-ge 2025-07-05 01:36:46,833 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605471/hsqldb-1.8.0.10.jar <- /home/ljm1/hsqldb-1.8.0.10.jar 2025-07-05 01:36:46,840 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/hsqldb-1.8.0.10.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605471/hsqldb-1.8.0.10.ja 2025-07-05 01:36:46,840 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605472/jackson-annotations-2.3.0.jar <- /home/ljm1/jackson-annotations-2.3.0.jar 2025-07-05 01:36:46,843 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/jackson-annotations-2.3.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605472/jackson- 2025-07-05 01:36:46,844 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605473/avro-1.7.5.jar <- /home/ljm1/avro-1.7.5.jar 2025-07-05 01:36:46,849 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/avro-1.7.5.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605473/avro-1.7.5.jar 2025-07-05 01:36:46,849 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605474/ant-contrib-1.0b3.jar <- /home/ljm1/ant-contrib-1.0b3.jar 2025-07-05 01:36:46,852 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/ant-contrib-1.0b3.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605474/ant-contrib-1.0b 2025-07-05 01:36:46,853 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605475/commons-compress-1.4.1.jar <- /home/ljm1/commons-compress-1.4.1.jar 2025-07-05 01:36:46,856 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/commons-compress-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605475/commons-com 2025-07-05 01:36:46,856 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605476/mysql-connector-java-5.1.47.jar <- /home/ljm1/mysql-connector-java-5.1.47.jar 2025-07-05 01:36:46,864 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/mysql-connector-java-5.1.47.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605476/mysql- 2025-07-05 01:36:46,865 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605477/slf4j-api-1.6.1.jar <- /home/ljm1/slf4j-api-1.6.1.jar 2025-07-05 01:36:46,869 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/slf4j-api-1.6.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605477/slf4j-api-1.6.1.ja 2025-07-05 01:36:46,869 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605478/opencsv-2.3.jar <- /home/ljm1/opencsv-2.3.jar 2025-07-05 01:36:46,873 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/opencsv-2.3.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605478/opencsv-2.3.jar 2025-07-05 01:36:46,874 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605479/parquet-column-1.4.1.jar <- /home/ljm1/parquet-column-1.4.1.jar 2025-07-05 01:36:46,878 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-column-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605479/parquet-colum 2025-07-05 01:36:46,879 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605480/jackson-core-asl-1.9.13.jar <- /home/ljm1/jackson-core-asl-1.9.13.jar 2025-07-05 01:36:46,882 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/jackson-core-asl-1.9.13.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605480/jackson-co 2025-07-05 01:36:46,882 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605481/snappy-java-1.0.5.jar <- /home/ljm1/snappy-java-1.0.5.jar 2025-07-05 01:36:46,888 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/snappy-java-1.0.5.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605481/snappy-java-1.0. 2025-07-05 01:36:46,889 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605482/commons-codec-1.4.jar <- /home/ljm1/commons-codec-1.4.jar 2025-07-05 01:36:46,893 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/commons-codec-1.4.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605482/commons-codec-1. 2025-07-05 01:36:46,893 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605483/commons-logging-1.1.1.jar <- /home/ljm1/commons-logging-1.1.1.jar 2025-07-05 01:36:46,897 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/commons-logging-1.1.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605483/commons-logg 2025-07-05 01:36:46,898 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605484/commons-io-1.4.jar <- /home/ljm1/commons-io-1.4.jar 2025-07-05 01:36:46,902 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/commons-io-1.4.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605484/commons-io-1.4.jar 2025-07-05 01:36:46,903 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605485/commons-jexl-2.1.1.jar <- /home/ljm1/commons-jexl-2.1.1.jar 2025-07-05 01:36:46,906 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/commons-jexl-2.1.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605485/commons-jexl-2. 2025-07-05 01:36:46,907 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605486/jackson-databind-2.3.1.jar <- /home/ljm1/jackson-databind-2.3.1.jar 2025-07-05 01:36:46,913 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/jackson-databind-2.3.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605486/jackson-dat 2025-07-05 01:36:46,913 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605487/parquet-jackson-1.4.1.jar <- /home/ljm1/parquet-jackson-1.4.1.jar 2025-07-05 01:36:46,916 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-jackson-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605487/parquet-jack 2025-07-05 01:36:46,916 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605488/paranamer-2.3.jar <- /home/ljm1/paranamer-2.3.jar 2025-07-05 01:36:46,919 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/paranamer-2.3.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605488/paranamer-2.3.jar 2025-07-05 01:36:46,920 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605489/parquet-common-1.4.1.jar <- /home/ljm1/parquet-common-1.4.1.jar 2025-07-05 01:36:46,924 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-common-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605489/parquet-commo 2025-07-05 01:36:46,925 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605490/avro-mapred-1.7.5-hadoop2.jar <- /home/ljm1/avro-mapred-1.7.5-hadoop2.jar 2025-07-05 01:36:46,929 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/avro-mapred-1.7.5-hadoop2.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605490/avro-map 2025-07-05 01:36:46,930 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605491/ant-eclipse-1.0-jvm1.2.jar <- /home/ljm1/ant-eclipse-1.0-jvm1.2.jar 2025-07-05 01:36:46,932 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/ant-eclipse-1.0-jvm1.2.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605491/ant-eclipse 2025-07-05 01:36:46,933 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605492/parquet-hadoop-1.4.1.jar <- /home/ljm1/parquet-hadoop-1.4.1.jar 2025-07-05 01:36:46,943 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-hadoop-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605492/parquet-hadoo 2025-07-05 01:36:46,943 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605493/mysql-connector-java-5.1.32.jar <- /home/ljm1/mysql-connector-java-5.1.32.jar 2025-07-05 01:36:46,947 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/mysql-connector-java-5.1.32.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605493/mysql- 2025-07-05 01:36:46,947 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605494/parquet-format-2.0.0.jar <- /home/ljm1/parquet-format-2.0.0.jar 2025-07-05 01:36:46,950 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-format-2.0.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605494/parquet-forma 2025-07-05 01:36:46,950 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605495/jackson-core-2.3.1.jar <- /home/ljm1/jackson-core-2.3.1.jar 2025-07-05 01:36:46,960 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/jackson-core-2.3.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605495/jackson-core-2. 2025-07-05 01:36:46,960 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605496/parquet-encoding-1.4.1.jar <- /home/ljm1/parquet-encoding-1.4.1.jar 2025-07-05 01:36:46,966 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/parquet-encoding-1.4.1.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605496/parquet-enc 2025-07-05 01:36:46,967 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:sym/mapred/local/1751704605497/kite-data-mapreduce-1.0.0.jar <- /home/ljm1/kite-data-mapreduce-1.0.0.jar 2025-07-05 01:36:46,973 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setvers/sqoop-1.4.6/lib/kite-data-mapreduce-1.0.0.jar as file:/tmp/hadoop-ljm1/mapred/local/1751704605497/kite-dat 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605463/jackson-mapper-asl-1.9.13.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605464/kite-data-core-1.0.0.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605465/xz-1.0.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605466/kite-hadoop-compatibility-1.0.0.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605467/parquet-avro-1.4.1.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605468/sqoop-1.4.6.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605469/kite-data-hive-1.0.0.jar 2025-07-05 01:36:47,158 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605470/parquet-generator-1.4.1.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605471/hsqldb-1.8.0.10.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605472/jackson-annotations-2.3.0.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605473/avro-1.7.5.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605474/ant-contrib-1.0b3.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605475/commons-compress-1.4.1.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605476/mysql-connector-java-5.1.47.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605477/slf4j-api-1.6.1.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605478/opencsv-2.3.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605479/parquet-column-1.4.1.jar 2025-07-05 01:36:47,159 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605480/jackson-core-asl-1.9.13.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605481/snappy-java-1.0.5.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605482/commons-codec-1.4.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605483/commons-logging-1.1.1.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605484/commons-io-1.4.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605485/commons-jexl-2.1.1.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605486/jackson-databind-2.3.1.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605487/parquet-jackson-1.4.1.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605488/paranamer-2.3.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605489/parquet-common-1.4.1.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605490/avro-mapred-1.7.5-hadoop2.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605491/ant-eclipse-1.0-jvm1.2.jar 2025-07-05 01:36:47,160 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605492/parquet-hadoop-1.4.1.jar 2025-07-05 01:36:47,161 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605493/mysql-connector-java-5.1.32.jar 2025-07-05 01:36:47,188 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605494/parquet-format-2.0.0.jar 2025-07-05 01:36:47,188 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605495/jackson-core-2.3.1.jar 2025-07-05 01:36:47,188 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605496/parquet-encoding-1.4.1.jar 2025-07-05 01:36:47,188 INFO [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:maked/local/1751704605497/kite-data-mapreduce-1.0.0.jar 2025-07-05 01:36:47,213 INFO [main] mapreduce.Job (Job.java:submit(1294)) - The url to track the job: http://l 2025-07-05 01:36:47,214 INFO [main] mapreduce.Job (Job.java:monitorAndPrintJob(1339)) - Running job: job_local 2025-07-05 01:36:47,220 INFO [Thread-44] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471) 2025-07-05 01:36:47,468 INFO [Thread-44] output.FileOutputCommitter (FileOutputCommitter.java:<init>(108)) - F 2025-07-05 01:36:47,470 INFO [Thread-44] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)uce.lib.output.FileOutputCommitter 2025-07-05 01:36:47,482 ERROR [Thread-44] output.FileOutputCommitter (FileOutputCommitter.java:setupJob(314)) -ucts/_temporary/0 2025-07-05 01:36:47,686 INFO [Thread-44] mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting f 2025-07-05 01:36:47,688 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:84_0001_m_000000_0 2025-07-05 01:36:47,791 INFO [LocalJobRunner Map Task Executor #0] output.FileOutputCommitter (FileOutputCommiAlgorithm version is 1 2025-07-05 01:36:47,828 INFO [LocalJobRunner Map Task Executor #0] mapred.Task (Task.java:initialize(612)) - 2025-07-05 01:36:47,919 INFO [LocalJobRunner Map Task Executor #0] db.DBInputFormat (DBInputFormat.java:setTxIn isolation 2025-07-05 01:36:47,931 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:runNewMapper(7 2025-07-05 01:36:47,959 INFO [Thread-44] mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task 2025-07-05 01:36:47,966 WARN [Thread-44] mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local74545 java.lang.Exception: java.io.IOException: Mkdirs failed to create file:/user/hadoop/products/_temporary/0/_tempxists=false, cwd=file:/home/ljm1) at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) Caused by: java.io.IOException: Mkdirs failed to create file:/user/hadoop/products/_temporary/0/_temporary/attee, cwd=file:/home/ljm1) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:455) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:789) at org.apache.sqoop.mapreduce.RawKeyTextOutputFormat.getRecordWriter(RawKeyTextOutputFormat.java:98) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:647) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2025-07-05 01:36:48,217 INFO [main] mapreduce.Job (Job.java:monitorAndPrintJob(1360)) - Job job_local745453984 2025-07-05 01:36:48,221 INFO [main] mapreduce.Job (Job.java:monitorAndPrintJob(1367)) - map 0% reduce 0% 2025-07-05 01:36:48,226 INFO [main] mapreduce.Job (Job.java:monitorAndPrintJob(1380)) - Job job_local745453984 2025-07-05 01:36:48,258 INFO [main] mapreduce.Job (Job.java:monitorAndPrintJob(1385)) - Counters: 0 2025-07-05 01:36:48,265 WARN [main] mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group FileSystemapreduce.FileSystemCounter instead 2025-07-05 01:36:48,272 INFO [main] mapreduce.ImportJobBase (ImportJobBase.java:runJob(184)) - Transferred 0 b 2025-07-05 01:36:48,277 WARN [main] mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apach org.apache.hadoop.mapreduce.TaskCounter instead 2025-07-05 01:36:48,277 INFO [main] mapreduce.ImportJobBase (ImportJobBase.java:runJob(186)) - Retrieved 0 rec 2025-07-05 01:36:48,277 ERROR [main] tool.ImportTool (ImportTool.java:run(621)) - Error during import: Import j 这是怎么回事
最新发布
07-06
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值