lspm_project_end

本文介绍了事务的基本概念,包括原子性、一致性、隔离性和持久性等ACID特性,并详细阐述了在并发事务处理过程中可能出现的问题,如丢失更新、脏读、不可重复读及幻读等。此外还介绍了四种不同的事务隔离等级,以避免并发事务处理下产生的意外情况。
事务管理概述

“事务”是一个逻辑工作单元,它包括一系列的操作。事务处理可以确保除非事务性单元内的所有操作都成功完成,否则不会永久更新面向数据的资源。通过将一组相关操作组合为一个要么全部成功要么全部失败的单元,可以简化错误恢复并使应用程序更加可靠。事务包括4个基本特性,也就是我们常说的ACID,其中包括:
1.Atomic(原子性,这里的“原子”即代表事务中的各个操作不可分割)
事务中包含的操作被看作是一个逻辑单元,这个逻辑单元中的操作要么全部成功,要么全部失败。
2.Consistency(一致性)
一致性意味着,只有合法的数据才会被写入数据库,否则会回滚到最初状态。事务确保数据库的状态从一个一致状态转变为另一个一致状态。
3.Isolation(隔离性)
多个事务并发执行时,一个事务的执行不应影响其他事务的执行。
4.Durability(持久性)
已被提交的事务对数据库的修改应该永久保存在数据库中。

并发事务处理下产生的意外情况
1.丢失更新
事务1:更新一条记录。
事务2:更新事务1处理中的记录。
事务1:调用commit进行提交。
事务2:调用commit进行提交。
此时事务1所做的修改完全被事务2的修改覆盖,称为丢失更新。
当两个或多个事务选择同一行,然后基于最初选定的值更新该行时,会发生丢失更新问题。因为每个事务都不知道其它事务的存在,最后的更新将重写由其它事务所做的更新,这将导致数据丢失。

2.脏读(Dirty Read):一个事务读取到了另外一个事务没有提交的数据,所以你可能会看到一些最后被另一个事务回滚掉的数据。
事务1:更新一条记录。
事务2:读取事务1更新的记录。
事务1:调用commit进行提交或调用rollback进行回滚。
此时事务2读取到的数据是保存在数据库内存中的数据,称为脏读。读到的数据为脏数据

详细解释:脏读就是指当一个事务正在访问数据,并且对数据进行了修改,而这种修改还没有提交到数据库中,这时,另外一个事务也访问这个数据,然后使用了这个数据。因为这个数据是还没有提交的数据,那么另外一个事务读到的这个数据是脏数据,依据脏数据所做的操作可能是不正确的。

3.不可重复读(NonRepeatable Read):在同一事务中,两次读取同一数据,得到内容不同。即一个事务再次读取之前曾经读取过的数据时,发现该数据已经被另一个已提交的事务修改。
事务1:查询一条记录。
事务2:更新事务1查询的记录。
事务2:调用commit进行提交。
事务1:再次查询上次的记录。
此时事务1对同一数据查询了两次,可得到的内容不同,称为不可重复读。

4.幻读(Phantom Read):同一事务中,用同样的操作读取两次,得到的记录数不相同。即一个事务重新执行一个查询,返回一批符合查询条件的记录,但这些记录中包含了因为其它最近提交的事务而产生的新记录。
事务1:查询表中所有记录
事务2:插入一条或一批记录
事务2:调用commit进行提交
事务1:再次查询表中所有记录
此时事务1两次查询到的记录是不一样的,称为幻读

详细解释:幻读是指当事务不是独立执行时发生的一种现象,例如第一个事务对一个表中的数据进行了修改,这种修改涉及到表中的全部数据行。同时,第二个事务也修改这个表中的数据,这种修改是向表中插入一行新数据。那么,以后就会发生操作第一个事务的用户发现表中还有没有修改的数据行,就好象发生了幻觉一样。


事务隔离等级
为了避免并发事务处理下产生的意外情况,标准SQL规范定义了4中事务隔离等级。
1.Read Uncommitted
最低等级的事务隔离,直译就是读“未提交”,意思就是即使另一个并发事务还没有提交,当前事务也能读到这个改变,这是很不安全的。Read Uncommitted允许脏读,但不允许更新丢失。如果一个事务已经开始写数据,则另外一个事务则不允许同时进行写操作,但允许其他事务读此行数据。
此级别的事务隔离等级对于大多数逻辑严格的应用系统而言是难以接受的,脏读取的出现将为系统的并发逻辑带来极大隐患。

2.Read Committed
直译就是读“提交”,意思就是一个事务不会读到另一个事务已修改但未提交的数据。Read Committed允许不可重复读取,但不允许脏读取。读取数据的事务允许其他并发事务继续访问该行数据,但是未提交的写事务将会禁止其他事务访问该行。
此级别的事务隔离等级是最常用的,并且是大多数数据库的默认隔离级别,同时也适用于大多数系统。

3.Repeatable Read
直译就是“可重复读取”,这就是说同一事务先后执行相同查询语句的时候,得到的结果是一样的。这也意味着一个事务不可能更新已经由另一个事务读取但未提交(回滚)的数据。Repeatable Read禁止不可重复读取和脏读,但是有时可能出现幻读。读取数据的事务将会禁止写事务(但允许读事务),写事务则禁止任何其他事务。

4.Serializable
最高等级的事务隔离级别,也提供了最严格的隔离机制。直译就是“序列化”,意思是说这个事务执行的时候不允许别的事务并发执行。Serializable提供严格的事务隔离级别,可以防止脏读,不可重复读取和幻读,它要求事务序列化执行,事务只能一个接着一个地执行,但不能并发执行。
ldtcommon代码: """ .. module:: ldtcommon :synopsis: Constants and templates non dcc specific used in other packages. .. moduleauthor:: Ezequiel Mastrasso """ import lucidity import logging import os logger = logging.getLogger(__name__) LOOKDEVTOOLS_FOLDER = os.environ['LOOKDEVTOOLS'] #: Attributes for tagging meshes for surfacing and texture-to-mesh matching ATTR_SURFACING_PROJECT = "surfacing_project" ATTR_SURFACING_OBJECT = "surfacing_object" #: Attribute for tagging Materials. Values: name of assigned project or object ATTR_MATERIAL = "surfacing_material" #: Attribute for tagging material assignmnents. Values: 'project' or 'object'] ATTR_MATERIAL_ASSIGN = "surfacing_assign" #: Attribute for tagging viewport material. Values: 'color' or 'pattern'] ATTR_MATERIAL_VP = "surfacing_vp" #: Global string matching ratios to compare strings against lucidity parsed files. #: Notice that the ratio constant should be high enough, TEXTURE_MATCHING_RATIO = 90 TEXTURE_CHANNEL_MATCHING_RATIO = 90 #: Texture file template, ANCHOR RIGHT TEXTURE_FILE_PATTERN = '{surfacing_project}_{surfacing_object}_{channel}_{colorspace}.{udim}.{extension}' #: Default shader node to use DEFAULT_SHADER = 'PxrSurface' #: Materials json Config, contains texture name mappings to shader plugs CONFIG_MATERIALS_JSON = os.path.join( os.environ['LOOKDEVTOOLS'], 'python', 'ldtconfig', 'materials.json') def texture_file_template(custom_pattern=None): """ Get a lucidity Template object using a custom template. Kwargs: custom_pattern (str): Custom lucidity file pattern. Returns: lucity.Template object with the custom partern """ logger.info('Loading lucidity with:\n %s' % custom_pattern) texture_file_template = lucidity.Template( 'textureset_element', custom_pattern, anchor=lucidity.Template.ANCHOR_END # TODO (Eze) Add STRICT? ) return texture_file_template ldtmaya代码: """ .. module:: ldtmaya :synopsis: general maya functions. .. moduleauthor:: Ezequiel Mastrasso """ import ldtcommon import ldtutils from ldtcommon import ATTR_SURFACING_PROJECT from ldtcommon import ATTR_SURFACING_OBJECT from ldtcommon import ATTR_MATERIAL from ldtcommon import ATTR_MATERIAL_ASSIGN from ldtcommon import ATTR_MATERIAL_VP from ldtui import qtutils from Qt import QtGui, QtWidgets, QtCore from Qt.QtWidgets import QApplication, QWidget, QLabel, QMainWindow import os import sys import traceback import random import logging import pymel.core as pm import maya.mel as mel import maya.cmds as mc logger = logging.getLogger(__name__) def surfacingInit(): """ Initialize the scene for surfacing projects. Creates the surfacing root, an empty surfacing project and object, and runs the validation to create and connect the partition Returns: bool. Valid scene. """ root = create_surfacing_root() if not root.members: surfacing_project = create_surfacing_project("defaultProject") create_surfacing_object(surfacing_project, "defaultObject") validate_surfacing() def create_surfacing_root_node(): """Create projects root node""" surfacing_root = pm.createNode( "objectSet", name="surfacing_root" ) surfacing_root.setAttr( "surfacing_root", "", force=True ) return surfacing_root def create_surfacing_root(): """Create projects root if it doesnt exist.""" if not get_surfacing_root(): surfacing_root = get_surfacing_root() return surfacing_root else: return get_surfacing_root() def create_surfacing_project(name=None): """ Creates a surfacing project. Kwargs: name (str): surfacing project name """ if not name: name = "project" surfacing_project = pm.createNode( "objectSet", name=name ) surfacing_project.setAttr( ATTR_SURFACING_PROJECT, "", force=True ) create_surfacing_object(surfacing_project) get_surfacing_root().add(surfacing_project) update_surfacing_partition() return surfacing_project def create_surfacing_object(project, name=None): """ Creates a surfacing Object under a given project. Args: project (PyNode): surfacing project Kwargs: name (str): surfacing object name """ if not name: name = "object" surfacing_set = pm.createNode( "objectSet", name=name ) surfacing_set.setAttr( ATTR_SURFACING_OBJECT, "", force=True ) project.add(surfacing_set) return surfacing_set def get_surfacing_root(): """ Get the project root node. Returns: PyNode. Surfacing root node Raises: Exception. """ objSetLs = [ item for item in pm.ls(type="objectSet") if item.hasAttr("surfacing_root") ] if len(objSetLs) == 0: logger.info( "surfacing_root node found, creating one" ) return create_surfacing_root_node() elif len(objSetLs) > 1: raise Exception( "More than 1 surfacing_root node found, clean up your scene" ) return objSetLs[0] def get_surfacing_projects(): """ Get all surfacing Projects under the root. Returns: list. surfacing projects PyNodes list. """ objSetLs = [ item for item in pm.ls(type="objectSet") if item.hasAttr(ATTR_SURFACING_PROJECT) ] return objSetLs def get_surfacing_project_by_name(name=None): """ Get surfacing Project by name. Kwargs: name (str): surfacing project name. Returns: PyNode. Returns first found hit, we are assuming the objectSet name is equal to surfacing_project attr value. """ projects_list = get_surfacing_projects() for each in projects_list: if name == each.name(): return each return None def get_surfacing_object_by_name(name=None): """ Get surfacing Object by name. Kwargs: name (str): surfacing object name. Returns: PyNode. Returns first found hit, we are assuming the objectSet name is equal to surfacing_object attr value. """ projects_list = get_surfacing_projects() for prj in projects_list: objs = get_surfacing_objects(prj) for obj in objs: if name == obj.name(): return obj return None def delete_surfacing_project(project): """ Delete a surfacing_project, and its members. Args: project (PyNode): surfacing project. """ if is_surfacing_project(project): pm.delete(project.members()) def get_surfacing_objects(project): """ Get all surfacing Objects under the given surfacing project Args: project (PyNode): surfacing project """ if is_surfacing_project(project): return project.members() else: return [] def is_surfacing_project(project): """ Check if the node is a surfacing project Args: project (PyNode): surfacing project Returns: bool. True if it is. """ if project.hasAttr(ATTR_SURFACING_PROJECT): return True else: return False def is_surfacing_object(surfacing_object): """ Check if node is surfacing Object Args: surfacing_object (PyNode): surfacing_object """ if surfacing_object.hasAttr(ATTR_SURFACING_OBJECT): return True else: return False def remove_surfacing_invalid_members(): """ Pops all not-allowd member types from surfacing projects and objects. Only Allowed types: objectSets (surfacing_projects) inside the surfacing projects root objectSets (surfacing_object) inside surfacing projects transforms (that have a mesh) inside surfacing_object """ project_root = get_surfacing_root() for project in project_root.members(): if ( not project.type() == "objectSet" ): # TODO (eze) add check for attr project_root.removeMembers([project]) for project in get_surfacing_projects(): for object in get_surfacing_objects( project ): # TODO (eze) add check for attr if not object.type() == "objectSet": project.removeMembers([object]) else: for member in object.members(): if not member.type() == "transform": logger.info( "removing invalid member: %s" % member ) object.removeMembers([member]) elif not member.listRelatives( type="mesh" ): logger.info( "removing invalid member: %s" % member ) object.removeMembers([member]) def get_mesh_transforms(object_list): # TODO move to common """ Get all the mesh shapes transforms. Includes all descendants in hierarchy. Args: object_list (list): PyNode list of nodes. """ shapes_in_hierarchy = pm.listRelatives( object_list, allDescendents=True, path=True, f=True, type="mesh", ) shapes_transforms = pm.listRelatives( shapes_in_hierarchy, p=True, path=True, f=True ) return shapes_transforms def add_member(surfacing_object, transform): # TODO move to common """ Add transform to surfacing Object Args: surfacing_object (PyNode): surfacing object transform (PyNode): transform node """ pm.sets(surfacing_object, transform, fe=True) def add_mesh_transforms_to_surfacing_object( surfacing_object, object_list ): """ Add all mesh shape transforms -and descendants- from the list to a surfacing Object. Args: surfacing_object (PyNode): surfacing object object_list (list): object list """ pm.select() if is_surfacing_object(surfacing_object): for item in object_list: # Disconnect the objects from other Surf proj and obj for c in item.instObjGroups.listConnections(c=True, p=True): if is_surfacing_object(c[1].node()) or is_surfacing_project(c[1].node()): logger.info( "disconnecting from Surf project or obj: %s" % c[1].node() ) pm.disconnectAttr("%s"%c[0], "%s"%c[1]) for transform in get_mesh_transforms(item): pm.select(transform) add_member(surfacing_object, transform) def update_surfacing_partition(): """Recreate the partition node, and reconnects to all the surfacing objects objectSets.""" partitions = [ item for item in pm.ls(type="partition") if item.hasAttr("surfacing_partition") ] for each in partitions: logger.info( "disconnecting existing partition: %s" % each ) each.sets.disconnect() pm.delete(each) logger.info("deleted partition") surfacing_partition = pm.createNode( "partition", name="surfacing_partition" ) logger.info( "partition created: %s" % surfacing_partition ) surfacing_partition.setAttr( "surfacing_partition", "", force=True ) for project in get_surfacing_projects(): for object in get_surfacing_objects(project): pm.connectAttr( "%s.partition" % object, surfacing_partition.sets, na=True, ) logger.info( "partition connected: %s " % object ) def remove_invalid_characters(): """Remove not allowed characters from surfacing projects and names like '_'.""" project_root = get_surfacing_root() surfacing_projects = get_surfacing_projects() #invalid_character = '_' invalid_character = '*' for project in surfacing_projects: if invalid_character in project.name(): project.rename(project.name().replace(invalid_character, '')) logger.info( 'Invalid character removed from surfacing_project,' 'new name: %s' % project) for surfacing_object in get_surfacing_objects(project): if invalid_character in surfacing_object.name(): surfacing_object.rename( surfacing_object.name().replace(invalid_character, '')) logger.info( 'Invalid characters removed from surfacing_object,' 'new name: %s' % surfacing_object) def validate_surfacing(): """ Validate the scene. Removes invalidad characters and members, updates the partition, and mesh attributes. """ remove_invalid_characters() remove_surfacing_invalid_members() update_surfacing_partition() update_surfacing_attributes() def export_alembic(geo_list, file_path): """ Export alembic file from the object list. Args: geo_list (list): list of geometry to export file_path (str): export file path """ if geo_list and file_path: roots = " -root |" + " -root |".join( [str(x) for x in geo_list] ) cmd = ( r'-frameRange 0 0 -uvWrite -dataFormat ogawa ' r'-userAttrPrefix surfacing' + roots + ' -file ' + (file_path) ) logger.info("AbcExport: %s" % cmd) mc.AbcExport(j=cmd) logger.info( "Succesful Alembic export to: %s" % file_path ) def merge_surfacing_object_meshes(surfacing_object): """ Merge all the meshs assigned to a surfacing Object. Args: surfacing_object (PyNode): surfacing object Raises: BaseException. Could not merge member meshes. """ try: members = surfacing_object.members() logger.info("Merging members: %s" % members) geo_name = "%s_geo" % str(surfacing_object) if len(members) > 1: geo = pm.polyUnite(*members, n=geo_name) return geo[0] else: logger.info( "single object found, skipping merge: %s" % members[0] ) members[0].rename(geo_name) pm.parent(members[0], world=True) return members[0] except BaseException: logger.error( "Could not merge members of: %s" % surfacing_object ) return False def export_surfacing_project(project, subdiv_level=0, single_export=True, folder_path=False): """ Export surfacing Project to Alembic. Args: project (PyNode): surfacing project Kwargs: single_export (bool): is single export folder_path (str): Export folder path """ current_file = pm.sceneName() if single_export: save_unsaved_scene_() if not folder_path: folder_path = qtutils.get_folder_path() project_geo_list = [] if ldtutils.is_directory(folder_path) and is_surfacing_project(project): for each in get_surfacing_objects(project): merged_geo = merge_surfacing_object_meshes(each) if merged_geo: project_geo_list.append(merged_geo) if project_geo_list: if subdiv_level: for geo in project_geo_list: logger.info( "subdivision level: %s" % subdiv_level ) logger.info( "subdividing merged members: %s" % geo ) # -mth 0 -sdt 2 -ovb 1 -ofb 3 -ofc 0 -ost 0 -ocr 0 -dv 3 # -bnr 1 -c 1 -kb 1 -ksb 1 -khe 0 -kt 1 -kmb 1 -suv 1 # -peh 0 -sl 1 -dpe 1 -ps 0.1 -ro 1 -ch 1 pm.polySmooth( geo, mth=0, sdt=2, ovb=1, dv=subdiv_level ) export_file_path = os.path.join( folder_path, str(project) + ".abc" ) export_alembic(project_geo_list, export_file_path) export_surfacing_object_dir = os.path.join( folder_path, str(project) ) ldtutils.create_directoy(export_surfacing_object_dir) for geo in project_geo_list: export_root = " -root |" + geo export_surfacing_object_path = os.path.join( export_surfacing_object_dir + "/" + geo + ".abc" ) export_alembic( [geo], export_surfacing_object_path ) if single_export: pm.openFile(current_file, force=True) def export_all_surfacing_projects(folder_path=None, subdiv_level=0): """ Export all surfacing Projects. Kwargs: folder_path (str): folder to export files. """ save_unsaved_scene_() if not folder_path: folder_path = qtutils.get_folder_path() current_file = pm.sceneName() for project in get_surfacing_projects(): export_surfacing_project( project, subdiv_level, single_export=False, folder_path=folder_path ) pm.openFile(current_file, force=True) return True def save_unsaved_scene_(): # TODO move to common """Check the scene state, if modified, will ask the user to save it.""" if unsaved_scene(): if save_scene_dialog(): pm.saveFile(force=True) else: raise ValueError("Unsaved changes") def update_surfacing_attributes(): """ Create attributes on meshes of what surfacing object they are assigned to. Adds the attributes to all the shapes transforms assigned to surfacing objects. This will be used later for quick shader/material creation and assignment. """ for project in get_surfacing_projects(): project.setAttr(ATTR_SURFACING_PROJECT, project) logger.info( "Updating attributes for project: %s" % project ) for surfacing_object_set in get_surfacing_objects(project): logger.info( "\tUpdating attributes for object texture set: %s" % surfacing_object_set ) surfacing_object_set.setAttr( ATTR_SURFACING_OBJECT, surfacing_object_set ) members = surfacing_object_set.members() logger.info( "\t\tUpdating attr for meshes: %s" % members ) for member in members: member.setAttr( ATTR_SURFACING_PROJECT, project.name(), force=True, ) member.setAttr( ATTR_SURFACING_OBJECT, surfacing_object_set.name(), force=True, ) def set_wifreframe_color_black(): """Set the wireframe color to black in all mesh objects.""" transforms = pm.ls(type="transform") shape_transforms = get_mesh_transforms(transforms) for mesh in shape_transforms: mesh_shape = mesh.getShape() mesh_shape.overrideEnabled.set(1) mesh_shape.overrideRGBColors.set(0) mesh_shape.overrideColor.set(1) def set_wifreframe_color_none(): """Remove the wireframe color in all mesh objects.""" transforms = pm.ls(type="transform") shape_transforms = get_mesh_transforms(transforms) for mesh in shape_transforms: mesh_shape = mesh.getShape() mesh_shape.overrideEnabled.set(0) def set_wireframe_colors_per_project(): """ Set the wireframe color per surfacing project. For all meshes, sets it to black to start with, this implies that the mesh has not be assigned to any surfacing object yet will show black in the VP """ set_wifreframe_color_black() projects = get_surfacing_projects() for project in projects: random.seed(project) wire_color = random.randint(1, 31) for surfacingObject in get_surfacing_objects(project): for mesh in surfacingObject.members(): mesh_shape = mesh.getShape() try: mesh_shape.overrideEnabled.set(1) mesh_shape.overrideRGBColors.set(0) mesh_shape.overrideColor.set(wire_color) except: logger.error('Could not set override color for: %s, might ' 'belong to a display layer' % mesh ) def set_wireframe_colors_per_object(): """ Set the wireframe color per surfacing object. For all meshes, sets it to black to start with, this implies that the mesh has not be assigned to any surfacing object yet will show black in the VP """ set_wifreframe_color_black() projects = get_surfacing_projects() print projects for project in projects: for surfacingObject in get_surfacing_objects(project): for mesh in surfacingObject.members(): mesh_shape = mesh.getShape() try: mesh_shape.overrideEnabled.set(1) mesh_shape.overrideRGBColors.set(1) mesh_shape.overrideColorRGB.set( ldtutils.get_random_color(surfacingObject) ) except: logger.error('Could not set override color for: %s, might ' 'belong to a display layer' % mesh ) def set_materials_per_object(shader_type): """Create a material per surfacing project and assigns it""" delete_materials() projects = get_surfacing_projects() for project in projects: for obj in get_surfacing_objects(project): shader, shading_group = create_shader( type=shader_type) pm.select(obj) meshes = pm.ls(sl=True) pm.sets(shading_group, forceElement=meshes) pm.select(None) if shader_type == 'aiStandardSurface': shader.baseColor.set( ldtutils.get_random_color(obj) ) else: shader.color.set( ldtutils.get_random_color(obj) ) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL), 'obj', force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_ASSIGN), obj.name(), force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_VP), 'color', force=True) def set_materials_per_project(shader_type): """Create a material per surfacing project and assigns it""" delete_materials() projects = get_surfacing_projects() for project in projects: shader, shading_group = create_shader( type=shader_type) pm.select(project) meshes = pm.ls(sl=True) pm.sets(shading_group, forceElement=meshes) pm.select(None) if shader_type == 'aiStandardSurface': shader.baseColor.set( ldtutils.get_random_color(project) ) else: shader.color.set( ldtutils.get_random_color(project) ) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL), 'project', force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_ASSIGN), project.name(), force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_VP), 'color', force=True) def delete_materials(): """delete all material networks that have surfacing attributes""" all_shading_groups = pm.ls(type="shadingEngine") to_delete = [] for shading_group in all_shading_groups: if pm.hasAttr(shading_group, ATTR_MATERIAL): to_delete.append(shading_group) pm.delete(to_delete) def delete_materials_viewport(type=None): """ delete all material networks that have surfacing attributes. Kwargs: type (str): type of vp material to delete, usually 'color', or 'pattern' """ all_shading_groups = pm.ls(type="shadingEngine") to_delete = [] for shading_group in all_shading_groups: if pm.hasAttr(shading_group, ATTR_MATERIAL_VP): to_delete.append(shading_group) pm.delete(to_delete) def unsaved_scene(): """Check for unsaved changes.""" import maya.cmds as cmds return cmds.file(q=True, modified=True) def save_scene_dialog(): """ Ask the user to go ahead save or cancel the operation. Returns: bool. True is Ok clicked, false otherwise. """ msg = QtWidgets.QMessageBox() msg.setIcon(QtWidgets.QMessageBox.Information) msg.setText("Your scene has unsaved changes") msg.setInformativeText("") msg.setWindowTitle("Warning") msg.setDetailedText( "This tool will do undoable changes. It requires you to save your scene, and reopen it after its finished" ) msg.setStandardButtons( QtWidgets.QMessageBox.Ok | QtWidgets.QMessageBox.Cancel ) retval = msg.exec_() if retval == QtWidgets.QMessageBox.Ok: return True else: return False def create_file_node(name=None): """ Create a file node, and its 2dPlacement Node. Kwargs: name (str): file node name Returns: PyNode. Image file node """ file_node = pm.shadingNode( 'file', name=name, asTexture=True, isColorManaged=True) placement_name = '%s_place2dfile_nodeture' % name placement_node = pm.shadingNode( 'place2dTexture', name=placement_name, asUtility=True) file_node.filterType.set(0) pm.connectAttr(placement_node.outUV, file_node.uvCoord) pm.connectAttr(placement_node.outUvFilterSize, file_node.uvFilterSize) pm.connectAttr(placement_node.coverage, file_node.coverage) pm.connectAttr(placement_node.mirrorU, file_node.mirrorU) pm.connectAttr(placement_node.mirrorV, file_node.mirrorV) pm.connectAttr(placement_node.noiseUV, file_node.noiseUV) pm.connectAttr(placement_node.offset, file_node.offset) pm.connectAttr(placement_node.repeatUV, file_node.repeatUV) pm.connectAttr(placement_node.rotateFrame, file_node.rotateFrame) pm.connectAttr(placement_node.rotateUV, file_node.rotateUV) pm.connectAttr(placement_node.stagger, file_node.stagger) pm.connectAttr(placement_node.translateFrame, file_node.translateFrame) pm.connectAttr(placement_node.wrapU, file_node.wrapU) pm.connectAttr(placement_node.wrapV, file_node.wrapV) return file_node def create_shader(type='PxrSurface'): """ Create shaders and shading groups. Kwargs: type (str): type of material shader to create, for ie 'blinn' tag (str): tag to set in ATTR_MATERIAL, usually the surfacing project or surfacing object Returns: tuple. PyNode shader, and PyNode shading_group """ shader, shading_group = pm.createSurfaceShader(type) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL), '', force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_ASSIGN), '', force=True) pm.setAttr('%s.%s' % (shading_group, ATTR_MATERIAL_VP), '', force=True) return shader, shading_group def import_surfacing_textures(): """ TODO WE DONT REALLY NEED THIS DONT WE TODO THIS IS A WORKING HARDCODED IMPORT, IMPLEMENT CORRECTLY Import textures to surfacing objects or projects. Kwargs: parsed_files (list): list of lucidity parsed files with 'filepath' key key (str): surfacing attr to use for import, surfacing project or surfacing object shaders (list): a list of shaders, where the keys match the parsed files key to use for import """ import pymel.core as pm from ldtcommon import TEXTURE_FILE_PATTERN import ldtmaya import ldtutils import ldttextures textures_folder = '/run/media/ezequielm/misc/wrk/current/cabinPixar/textures' texture_list = ldtutils.get_files_in_folder( textures_folder, recursive=True, pattern='.tex') texture_finder = ldttextures.TextureFinder( TEXTURE_FILE_PATTERN, texture_list) texture_finder.get_channel_plug(texture_list[0]) for surfPrj in ldtmaya.get_surfacing_projects(): for surfObj in ldtmaya.get_surfacing_objects(surfPrj): # Find texture files with a matching surfacing_project, get udim paths texture_files = texture_finder.find_key_values( surfacing_project=surfPrj, merge_udims=True) if texture_files: print surfObj # create and assign the material to each surfacing_object pm.select(surfObj) meshes = pm.ls(sl=True) shader, shading_group = ldtmaya.create_shader() shader.rename('%s_%s' % (surfObj, 'material')) pm.sets(shading_group, forceElement=meshes) pm.select(None) for texture_file in texture_files: # get the shader plug input, to connect the texture to shader_plug = texture_finder.get_channel_plug(texture_file) if shader_plug: shader_plug = pm.PyNode( '%s.%s' % (shader.name(), shader_plug)) # create image nodes file_node = ldtmaya.create_file_node( '%s_%s' % (surfObj, shader_plug)) # paths come with 'udim', replac this with the prman <UDIM> file_node.fileTextureName.set( texture_file.replace('udim', '<UDIM>')) pm.setAttr('%s.%s' % (file_node, 'uvTilingMode'), 3) pm.setAttr('%s.%s' % (file_node, 'alphaIsLuminance'), 1) # TODO Query the shader plug, connect RGB or single channel # TODO if a normal or bump, create the inbetween node # if shader_plug == "normal" or shader_plug == "bump" print "plug %s -->%s" % (texture_file, shader_plug) if len(shader_plug.elements()) == 4: if "bump" in shader_plug.name(): bump_node = pm.shadingNode( 'bump2d', asTexture=True) bump_node.rename('%s_%s' % (surfObj, 'bump')) file_node.outAlpha.connect(bump_node.bumpValue) bump_node.outNormal.connect(shader_plug) else: file_node.outColor.connect(shader_plug) else: file_node.outAlpha.connect(shader_plug) ldtui代码:init_.py: """ .. module:: ldtui :synopsis: Main tools UI. .. moduleauthor:: Ezequiel Mastrasso """ from Qt import QtGui, QtWidgets, QtCore from Qt.QtWidgets import QApplication, QWidget, QLabel, QMainWindow import sys import imp import os import logging from functools import partial from ldtui import qtutils import ldt logger = logging.getLogger(__name__) class LDTWindow(QMainWindow): '''Main Tools UI Window. Loads the plugInfo.plugin_object.plugin_layout QWidget from all loaded plugins as tabs''' def __init__(self, plugins): super(LDTWindow, self).__init__() self.setWindowTitle("Look Dev Tool Set") self.setGeometry(0, 0, 650, 600) layout = QtWidgets.QGridLayout() self.setLayout(layout) tabwidget = QtWidgets.QTabWidget() tabwidget.setTabBar(qtutils.HTabWidget(width=150, height=50)) tabwidget.setTabPosition(QtWidgets.QTabWidget.West) # Stylesheet fix for Katana # With default colors, the tab text is almost the # same as the tab background stylesheet = """ QTabBar::tab:unselected {background: #222222;} QTabWidget>QWidget>QWidget{background: #222222;} QTabBar::tab:selected {background: #303030;} QTabWidget>QWidget>QWidget{background: #303030;} """ tabwidget.setStyleSheet(stylesheet) layout.addWidget(tabwidget, 0, 0) plugins_ui = {} plugins_buttons = {} for pluginInfo in plugins.getAllPlugins(): tabwidget.addTab( pluginInfo.plugin_object.plugin_layout, pluginInfo.name) self.setCentralWidget(tabwidget) qtutils.py: """ .. module:: qtutils :synopsis: small qt utilies and custom widgets. .. moduleauthor:: Ezequiel Mastrasso """ from Qt import QtGui, QtWidgets, QtCore from Qt.QtWidgets import QApplication, QWidget, QLabel, QMainWindow import logging logger = logging.getLogger(__name__) def get_folder_path(): """Gets a folder path from the user""" file_dialog = QtWidgets.QFileDialog() file_dialog.setFileMode(QtWidgets.QFileDialog.Directory) if file_dialog.exec_(): path = str(file_dialog.selectedFiles()[0]) return path else: return None class HTabWidget(QtWidgets.QTabBar): ''' QPaint event to draw the QTabWidget titles horizontally ''' def __init__(self, *args, **kwargs): self.tabSize = QtCore.QSize(kwargs.pop('width'), kwargs.pop('height')) super(HTabWidget, self).__init__(*args, **kwargs) def paintEvent(self, event): painter = QtWidgets.QStylePainter(self) option = QtWidgets.QStyleOptionTab() for index in range(self.count()): self.initStyleOption(option, index) tabRect = self.tabRect(index) tabRect.moveLeft(10) painter.drawControl(QtWidgets.QStyle.CE_TabBarTabShape, option) painter.drawText(tabRect, QtCore.Qt.AlignVCenter | QtCore.Qt.TextDontClip, self.tabText(index)) def tabSizeHint(self, index): return self.tabSize ldtutils代码: """ .. module:: ldtutils :synopsis: general non dcc specific utils. .. moduleauthor:: Ezequiel Mastrasso """ from ldtcommon import CONFIG_MATERIALS_JSON from ldtcommon import TEXTURE_CHANNEL_MATCHING_RATIO from ldtcommon import TEXTURE_MATCHING_RATIO from fuzzywuzzy import fuzz import subprocess import multiprocessing import sys import json import logging import os import random import lucidity logger = logging.getLogger(__name__) def create_commands(texture_mapping): default_command = "maya -batch -file someMayaFile.mb -command " commands = [] for key, value in texture_mapping: dir, filename = os.path.split(key) filename, ext = os.path.splitext(filename) filename = os.path.join(dir, filename + "WithTexture." + ext) commands.append("".format(default_command, "abc_file", key, "texture", value, "file -save ", filename)) return commands def launch_function(func, args): commands = create_commands(args) launch_multiprocess(launch_subprocess, commands) def launch_subprocess(command): try: subprocess_output = subprocess.check_output(command) logger.info("Subprocess launched\t{out}\nrunning the command\t{command}", out=subprocess_output, command=command) except subprocess.CalledProcessError as e: logger.exception( "Error while trying to launch subprocess: {}".format(e.output)) raise return command def launch_multiprocess(function, args): """ :param function: Function to be called inside the multiprocess -- Takes only 1 arg :param args: list/tuple of arguments for above function :return: """ multiprocessing.freeze_support() pool = multiprocessing.Pool(processes=int(multiprocessing.cpu_count()/2)) logger.debug("Pool created") try: pool_process = pool.map_async(function, (args)) except Exception as e: msg = "Error while trying to launch process in pool: {}".format(e) logger.exception(msg) raise finally: pool.close() pool.join() try: logger.info("output from the process: {pool_out}", out=pool_process.successful()) return 0 except AssertionError: logger.exception("Couldn't communicate with the process poll created; \ No output from processes fetched") return 1 def map_textures_to_alembic(texture_mapping): launch_subprocess(command) def load_json(file_path): """ Load a json an returns a dict. Args: file_path (str): Json file path to open. """ with open(file_path) as handle: dictdump = json.loads(handle.read()) return dictdump def save_json(file_path, data): """ Dump a dict into a json file. Args: file_path (str): Json file path to save. data (dict): Data to save into the json file. """ # TODO (eze) pass def get_random_color(seed): """ Return a random color using a seed. Used by all material creating, and viewport color functions that do not use textures, to have a common color accross dccs Args: seed (str): Returns: tuple, R,G,B colors. """ random.seed(seed + "_r") color_red = random.uniform(0, 1) random.seed(seed + "_g") color_green = random.uniform(0, 1) random.seed(seed + "_b") color_blue = random.uniform(0, 1) return color_red, color_green, color_blue def create_directoy(path): """ Create a folder. Args: path (str): Directory path to create. """ os.mkdir(path) logger.info("Directory created: %s" % path) def is_directory(path): """ Check if the given path exists, and is a directory. Args: path (str): Directory to check. """ if os.path.exists(path) and os.path.isdir(path): return True else: return False def get_files_in_folder(path, recursive=False, pattern=None): """ Search files in a folder. Args: path (str): Path to search. Kwards: recursive (bool): Search files recursively in folder. pattern (str): pattern to match, for ie '.exr'. Returns: array. File list """ logger.info("Searching for files in: %s" % path) logger.info("Searching options: Recursive %s, pattern: %s" % (recursive, pattern)) file_list = [] for path, subdirs, files in os.walk(path): for file in files: # skip .mayaswatchs stuff if ".maya" not in file: if pattern: if pattern in file: file_list.append(os.path.join(path, file)) logger.debug( "File with pattern found, added to the list: %s" % file) else: file_list.append(os.path.join(path, file)) logger.debug("File added to the list: %s" % file) if not recursive: break return file_list def string_matching_ratio(stringA, stringB): """ Compare two strings and returns a fuzzy string matching ratio. In general ratio, partial_ratio, token_sort_ratio and token_set_ratio did not give different results given that we are comparin a single. TODO: Try bitap algorithm for fuzzy matching, partial substring matching might be better for our cases. Different channels fuzzy ratio comparission ('baseColor','diffusecolor') = 67 ('base','diffusecolor') = 25 ('specular','specularColor') = 76 ('specular','specularcolor') = 76 ('specular_color', 'specular_bump') = 67 ('coat_color', 'coat_ior') = 78 ('secondary_specular_color', 'secondary_specular_ior') = 91 ('subsurface_weight', 'subsurface_Color') = 67 ('emission', 'emission_weight') = 70 Same channel diferent naming ratio comparission ('diffuse_weight','diffuseGain') = 64 Args: stringA (str): string to compare against. stringB (str): string to compare. Returns: int. Ratio, from 0 to 100 according to fuzzy matching. """ return fuzz.token_set_ratio(stringA, stringB) def get_config_materials(): """ Gets the CONFIG_MATERIALS_JSON as a dict Returns: dict. CONFIG_MATERIALS_JSON """ return load_json(CONFIG_MATERIALS_JSON)
08-21
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值