数据处理(工具)

 2023-09-05 阅读 226 评论 0

摘要:2019独角兽企业重金招聘Python工程师标准>>> Format(Source/Staging/Target) CSV Json XML (GEXF) Table/ViewMemoryVector/MatrixRDD/DataFrame/DataSetNDArray/DataFrame Store(Source/Staging/Target) Txt file CSV file Json file XML file (GEXF) DB table Mem

2019独角兽企业重金招聘Python工程师标准>>> hot3.png

Format(Source/Staging/Target)

CSV
Json
XML (GEXF)
Table/ViewMemoryVector/MatrixRDD/DataFrame/DataSetNDArray/DataFrame

Store(Source/Staging/Target)

Txt file
CSV file
Json file
XML file (GEXF)
DB table
Memory Map
Memory List
Memory ObjectNDArray/Matrix(Numpy)Series/DataFrame/Panel(Pandas)RDD/DataFrame/DataSet(Spark)
Special fileparquet...

Generator(Source)

spawnerkettle

CLI Tool

Programming CLI: octave/gnuplot (script for plot)Format CLI: Graphviz (Dot for network)Format CLI: plantuml(Sequence/UML for network)Format CLI: vega (json for plot)

WUI/GUI Tool

Refine: Excel,Weka,DataCleanerRefine WUI: DataWranglerAggresive GUI: Excel ggobi(高维可视化) pspp(gnuspss, 统计) sofastats(统计) sagemath(python, 代数)ETL: KettleMining: JDMP(java) Weka(java) Orange2(python2, 推荐) Orange3(python3, 推荐) knime(java, 推荐) RapidMiner(java)Visual GUI: Excel/PPT/AI, Weka, TableauPublic(windows&mac推荐)Gis/Map: qgis, udigVisual GUI: ParaViewProgramming GUI: ProcessingDesign GUI: Inkcape(矢量) GIMP(位图) ImageMagick(处理)Design GUI(2d/动画): Synfig/SynfigStudioDesign GUI(3d/动画): Blender Timeline GUI: timeflow Time-Series WUI: FacetteRelation GUI: Gephi, cytoscape, Excel(NodeXL)Circos/Genue GUI: CircosVisual WUI(Dev): phpMyAdmin(php推荐, dev)  SqlPad(nodejs推荐 dev)Visual WUI(BI): raw(python推荐 design)datawrapper(php推荐 design)metabase(java推荐 dev)superset(python推荐 dev), redash(python推荐  dev)lyra2(nodejs推荐  design) voyager(nodejs+vega推荐, dev)spark-notebook(java/scala推荐 dev)zeppelin(java/scala推荐,支持几乎所有数据源,支持大数据 dev)jupyter(python推荐,支持几乎所有数据源,支持大数据 dev)

Online/Cloud Web Visual Tool

rawgraphs.io(python, open source, local web version is raw,可做报表)www.datawrapper.de (php, open source, local web version is datawrapper,可做报表)chartblocks.com (免费版本功能过于简单)wolframalpha.com (画公式,适合分析公式)infogr.am (付费版本可导出pdf和png,适合做报表)canva.com (偏向于平面设计,免费导出的pdf和png带有水印)moojin.com(国内,个人用户免费,非常值得推荐)tushuo.com(百度)tubiaoxiu.com(国内,个人用户免费,数据量受限,非常值得推荐)bluemix.net(IBM,收费,但很推荐)apex.oracle.com(oracle,收费,评估版免费,但很推荐)visualizefree.com

Java/Scala tool&sdk

Hive
Spark
Kylin

Javascript sdk

echart.js     (chart)
datavis/g2.js (chart)
flotr2.js     (chart)
jsxgraph.js   (science)
vis.js        (timeline,network,chart&chart3d)
three.js      (3d)
leaflet.js    (map)
plotly.js     (plot) 
list.js       (list)
jquery.dataTables.js(table)
bootstrap-table.js  (table)
strapdown.js  (markdown with <xmp>)
datavis/g6.js (relation graph from text) 
arbor.js      (relation graph from text) 
sigma.js      (relation graph from json or gexf)
gexfjs.js     (relation graph from gexf)
linkurious=>ogma.js    (商业,relation graph based on sigma.js)
popoto.js     (relation graph from neo4j rest with cypher)
keylines.js   (relation graph from neo4j with cypher)
alchemy.js    (relation graph from json)
viz.js        (relation graph from dot)
dygraph.js         (finance)
smoothie.js        (realtime chart)
TimeLine/Timeplots (time)
labella.js         (timeline)
metricsgraphics.js (realtime chart)
envision.js        (timeseries + finance)
Tangle             (formular)
datatables.js      (table) 
express.js         (ppt) 
cytoscape.js       (genue)
jit.js             (graph&tree) 
d3-cloud.js        (wordcloud)
three.js
raphael.js
d3.js
procesing.js

Other

SVG (xml)
VizJSON(IBM)
NetLogo(jvm language, model, simulation)
matplotlib(python)
breeze-viz(scala)
ggplot(R)
HTML/CSS
FF chartwell (Font)
Tikz (PGF/LaTeX)
Markdown (markdown)
scrot(截图)
istanbul(录屏)
vatic(video label)
LabelImg(image label)
Anafora(text label)

 

转载于:https://my.oschina.net/igooglezm/blog/857126

版权声明:本站所有资料均为网友推荐收集整理而来,仅供学习和研究交流使用。

原文链接:https://hbdhgg.com/1/799.html

发表评论:

本站为非赢利网站,部分文章来源或改编自互联网及其他公众平台,主要目的在于分享信息,版权归原作者所有,内容仅供读者参考,如有侵权请联系我们删除!

Copyright © 2022 匯編語言學習筆記 Inc. 保留所有权利。

底部版权信息