lindan1984的专栏

原创 码农黑话-缩写用语

RTFM是一个网络语言，意思是：“去读那些他妈的手册”（Read The Fucking Manual），这句话通常用在回复那些只要查阅文件就可以解决，拿出来提问只是浪费别人时间的问题。AFAIK/AFAICT  —  as far as I know / can tellLGTM  —  Looks good to me.IANAL  — “ I am not a lawyer ”, but I smell licensing issuesIMO  — （In my opinion），在我看来.

原创 Python Rule Engine

Those rule engines in python are:pyDatalog Pyke PyCLIPS durable_rules Intellect business-rules PyKnowRelative question link in stackoverflow:Python Rule Based Engine Open Source based Rules Engines in Java or Python Implementing a "rules engin

原创 Postgresql

PostgreSQL vs MySQLhttps://www.cnblogs.com/geekmao/p/8541817.html数据迁移 —— 从 PostgreSQL 到 MySQLhttps://www.cnblogs.com/xjnotxj/p/12776575.htmlPG2MySQLhttps://github.com/pivotal-cf/pg2mysqlIn PostgreSQL it is common to use thetextdatatype for ch..

原创 阿里云大数据

图计算https://help.aliyun.com/document_detail/134413.html?spm=a2c4g.11186623.6.561.44e366f2XItg8jGraph Studio简介Graph Studio是Dataworks旗下一站式图计算研发平台，为图应用开发者提供了实例建模、数据导入、数据查询、可视化分析等一站式的研发服务。Graph Studio核心功能特性如下：实例建模：用户可以通过列表模式和可视化模式快速构建图实例的点/边 数据导入：支持m

原创 阿里云日志分析

分析uwsgi日志耗时* | select approx_percentile(try_cast(time as bigint),Array[0.5,0.85,0.95]), max(try_cast(time as bigint)) as max, count(time) as count from (select regexp_extract(content, '.* in (\d+) msecs .*', 1) as time from log)

原创 zstdmd

Refhttps://manpages.debian.org/unstable/zstd/zstdmt.1.en.html

原创 Set -e -x

They are options passed tobashseehelp setfor more info, in this case:-x Print commands and their arguments as they are executed.-e Exit immediately if a command exits with a non-zero status.

原创 python percent_to_float

参考代码def percent_to_float(data): """Convert percentage string to float. e.g. 99% -> 0.99 """ if data is None: return 0.0 if isinstance(data, (int, float)): return float(data) return float(data.strip('%')) / 1.

原创 pytest capture ouptut

During test execution any output sent tostdoutandstderris captured. If a test or a setup method fails its according captured output will usually be shown along with the failure traceback. (this behavior can be configured by the--show-capturecommand-l...

原创 Python Articles

flask 2.0 releasehttps://palletsprojects.com/blog/flask-2-0-released/

原创 python pip 依赖冲突定位

今天pip安装一直遇到Jinja2冲突可以使用pipdeptree定位冲突原因说明文档https://pypi.org/project/pipdeptree/pipdeptree -r -p Jinja2Warning!!! Possibly conflicting dependencies found:* Flask==2.0.0 - Jinja2 [required: >=3.0, installed: 2.11.3]* networkx==2.5.1 - deco.

原创 阿里云日志服务数据加工

日志服务可以使用DSL进行加工处理阿里云帮助文档数据加工语法简介https://www.alibabacloud.com/help/zh/doc-detail/125439.htm?spm=a2c63.p38356.b99.358.1d114889OpfTP1函数总览https://help.aliyun.com/document_detail/159702.html?spm=a2c4g.11186623.6.1004.3a9628c75XwwfpSamplee_if( ..

原创 Python *args and **kwargs

总结*argsand**kwargsare special keyword which allows function to take variable length argument. *argspasses variable number of non-keyworded arguments list and on which operation of the list can be performed. **kwargspasses variable number of keywor...

原创 poetry

poetry commandpoetry installpoetry buildpoetry install -E serverpoetry run pytest -v --cov=lxapi --cov-config .coveragercpoetry buildpoetry update xxxpyproject.tomlhttps://python-poetry.org/docs/pyproject/lock versionhttps://github.com/p

原创 Python Logging

Python loggine default level is warningThe default logging level is warning. Since you haven't changed the level, the root logger's level is still warning. That means that it will ignore any logging with a level that is lower than warning, including debu

原创 python json schema validation

schema自动生成-gensonhttps://pypi.org/project/genson/builder = SchemaBuilder()builder.add_object(data)fp = open("test.txt", "w")print(builder.to_json(indent=4, ensure_ascii=False), file=fp)fp.close()schema校验-gsonschemahttps://pypi.org/project/j.

原创 pycharm技能

自动生成带参数的docstringhttps://stackoverflow.com/questions/36292999/pycharm-does-not-auto-create-documentation-stubs生成格式类型 """ :param investor: :type investor: :return: :rtype: """

原创 限流ratelimit示例参考

python ratelimit decoratorhttps://github.com/tomasbasham/ratelimittwitter rate limithttps://python-twitter.readthedocs.io/en/latest/_modules/twitter/ratelimit.htmlguava rate limithttps://www.baeldung.com/guava-rate-limiter

原创 Python开发工具

IDEpycharm community对比专业版少了web开发，django等https://www.jetbrains.com/pycharm/features/editions_comparison_matrix.htmlPycharm pluginsEnvFilehttps://plugins.jetbrains.com/plugin/7861-envfile

原创 bump version

可以通过工具自动bumphttps://github.com/peritus/bumpversion

原创 JAVA8 CompletableFuture

JAVA 8 CompletableFuture特点JAVA8直接支持使用简单异步基于ForkJoinPool限制all不返回结果combine可以两两合并返回合并结果

原创 Python Log Config

参考https://github.com/madzak/python-json-loggerhttps://github.com/hynek/structlog示例propogate设置为False，否则root logger也会输出trigger_logger = logging.getLogger("trigger")logHandler = logging.StreamHandler()formatter = jsonlogger.JsonFormatter(json_en

原创 python virtualenv

开始: virtualenv venv进入: source venv/bin/activate退出: deactivate

原创 JAVA Stream处理

代码用例filter & sorted & forEach List<Processor> processors = processorRegistry.getProcessors(); processors.stream().filter(it -> { return StringUtil.equals(POST, it.type())

原创 网关实现

参考Zuul实现前置后置过滤器过滤器注册器githubhttps://github.com/Netflix/zuul/blob/be48a05641c2d5a5aa507539150f42d46c7120cc/zuul-core/src/main/java/com/netflix/zuul/filters/MutableFilterRegistry.java不用翻墙的国内代码https://gitee.com/netflix/zuulZuul 1.x的处理器逻辑https://g

原创 JAVA正则处理

正则工具https://regex101.com/java8正则笔记https://zq99299.github.io/java-tutorial/essential/regex/介绍正则表达式(regex)即一种搜索字符串中模式(pattern)。模式可以是任意的字符串，或者是一个复杂的表达式。正则主要应用在字符串的搜索，编辑等操作上。语法1 如下egrep使用的是正则的语法，虽然是命令行，但内涵一样。.代表任意的字符串，所以egrep搜索字符的时候所以的字符都是红色的，...

原创 手动rebase:一种merge操作

手动rebase:一种merge操作• 1.checkout master分支：git checkout master• 2.master 分支更新：git pull -p• 3.checkout 开发分支：git checkout {dev_branch}• 4.开发分支更新：git pull -p• 5.发起 merge(一定要checkout在本地分支): git merge master• 6.解决冲突...

原创 mac下安装mysql

一直用的docker的mysql，今天尝试在mac下安装mysql，还是踩了一些坑。安装brew install mysql@5.7重置密码brew services stop mysql@5.7 cd /usr/local/opt/mysql@5.7/bin /mysqld_safe --skip-grant-tables Command+N新开窗口 mysql -u r...

原创 分层设计

Repository的使用https://segmentfault.com/a/1190000012346333Repository蕴含着真正的OO概念，即一个数据仓库角色，负责所有对象的持久化管理。DAO则没有摆脱数据的影子，仍然停留在数据操作的层面上。Repository是相对对象而言，DAO则是相对数据库而言，虽然可能是同一个东西 ，但侧重点完全不同。Repository居于业务...

原创 Mybatis出坑记

Springboot mybatis集成 Invalid bound statement (not found)https://blog.youkuaiyun.com/qq_35981283/article/details/78590090后来实在没办法了，跟以前的项目逐一比对，发现application.properties中忘记了mybatise的两行配置：mybatis.typeAliase...

原创 Mac技能

Where is gradle installed on my machttp://intrepidjava.com/gradle-installed-mac/Now navigate to/usr/local/binand run 1 ls -la gradle The result will be 1 2 ...

原创 架构设计摘要

领域模型，你真的理解的了吗？https://www.jianshu.com/p/fe45506ea358领域模型是分析业务的分析模型，在实际项目中主要由系统分析师在分析阶段中使用。DDD的“领域模型”是综合分析、设计的模型，在实际项目中横跨分析和设计两个阶段，岗位需要具备“系统分析师”和“系统设计师”的综合能力。领域模型主要内容：业务实体 业务实体之间关系“领域模型”主要内...

原创 Visual Paradigm使用技能

Why there are “a” and “M” icon showing in my shapes?https://knowhow.visual-paradigm.com/diagramming/a-and-m-icon/

原创 数据产品架构

https://zhuanlan.zhihu.com/p/34258166https://zhuanlan.zhihu.com/p/43937116

原创 切面捕获异常

@Aspectpublic class RiskExceptionAspect { private static final Logger logger = LoggerFactory.getLogger(LoggerNamesConstants.RISK); @Pointcut(value = "execution(* com.xxx.risk..*.*(..))") ...

原创 什么是Dimension table(维表)

什么是Dimension table(维表)Dimension Table概念多出现于数据仓库里面，维表与事实表想对应，比如一个 “销售统计表” 就是一个 事实表，而 “销售统计表” 里面统计数据的来源离不开 “商品价格表”，“商品价格表” 就是销售统计的一个维度表。事实数据和维度数据的识别必须依据具体的主题问题而定。“事实表” 用来存储事实的度量及指向各个维的外键值。维表用来保存该维的元数据...

原创 怎么写好release note

怎么写好release note。https://www.zhihu.com/question/21207358/answer/57746997https://www.productplan.com/release-notes-best-practices/https://www.jianshu.com/p/8ff449fc83a7

原创 AARRR漏斗模型

原创 工单系统

国内的FeelDeskhttp://www.feeldesk.cn/news/index.html集成钉钉代码需购买，但可开放定制美服云客服工单系统https://www.meetfine.com/help/index.htmlPESCMS-Tickethttps://gitee.com/fallBirds/PESCMS-Ticket参考知乎文章https://w...

原创 自动刷新按钮举例

var $j = $$; setInterval(function(){$j('#newPost .btn-box button')[0].click();}, 30000);延时30s模拟点击按钮