데이터 저널리즘을 돕는 구글 도구 7선

TensorFlow-Tutorials

Introduction to deep learning based on Google's TensorFlow framework. These tutorials are direct ports of Newmu's Theano Tutorials.

Topics

• Simple Multiplication
• Linear Regression
• Logistic Regression
• Feedforward Neural Network (Multilayer Perceptron)
• Deep Feedforward Neural Network (Multilayer Perceptron with 2 Hidden Layers O.o)
• Convolutional Neural Network
• Denoising Autoencoder
• Recurrent Neural Network (LSTM)
• Word2vec
• TensorBoard
• Save and restore net
• Generative Adversarial Network

Dependencies

• TensorFlow 1.0 alpha
• Numpy
• matplotlib

# TensorFlow-Tutorials

[](https://travis-ci.org/nlintz/TensorFlow-Tutorials)

[](https://www.codacy.com/app/hunkim/TensorFlow-Tutorials)

Introduction to deep learning based on Google's TensorFlow framework. These tutorials are direct ports of

Newmu's [Theano Tutorials](https://github.com/Newmu/Theano-Tutorials).

***Topics***

* [Simple Multiplication](00_multiply.py)

* [Linear Regression](01_linear_regression.py)

* [Logistic Regression](02_logistic_regression.py)

* [Feedforward Neural Network (Multilayer Perceptron)](03_net.py)

* [Deep Feedforward Neural Network (Multilayer Perceptron with 2 Hidden Layers O.o)](04_modern_net.py)

* [Convolutional Neural Network](05_convolutional_net.py)

* [Denoising Autoencoder](06_autoencoder.py)

* [Recurrent Neural Network (LSTM)](07_lstm.py)

* [Word2vec](08_word2vec.py)

* [TensorBoard](09_tensorboard.py)

* [Save and restore net](10_save_restore_net.py)

* [Generative Adversarial Network](11_gan.py)

***Dependencies***

* TensorFlow 1.0 alpha

* Numpy

* matplotlib

.

https://www.tensorflow.org/api_docs/python/tf/compat

Module: tf.compat

scikit-learn: machine learning in Python http://scikit-learn.org

https://github.com/scikit-learn/scikit-learn

scikit-learn

scikit-learn is a Python module for machine learning built on top of SciPy and distributed under the 3-Clause BSD license.

The project was started in 2007 by David Cournapeau as a Google Summer of Code project, and since then many volunteers have contributed. See the AUTHORS.rst file for a complete list of contributors.

It is currently maintained by a team of volunteers.

Website: http://scikit-learn.org

Installation

Dependencies

scikit-learn requires:

• Python (>= 2.7 or >= 3.3)
• NumPy (>= 1.6.1)
• SciPy (>= 0.9)

For running the examples Matplotlib >= 1.1.1 is required.

scikit-learn also uses CBLAS, the C interface to the Basic Linear Algebra Subprograms library. scikit-learn comes with a reference implementation, but the system CBLAS will be detected by the build system and used if present. CBLAS exists in many implementations; see Linear algebra libraries for known issues.

User installation

If you already have a working installation of numpy and scipy, the easiest way to install scikit-learn is using pip

pip install -U scikit-learn

or conda:

conda install scikit-learn

The documentation includes more detailed installation instructions.

Development

We welcome new contributors of all experience levels. The scikit-learn community goals are to be helpful, welcoming, and effective. The Development Guide has detailed information about contributing code, documentation, tests, and more. We've included some basic information in this README.

Important links

• Official source code repo: https://github.com/scikit-learn/scikit-learn
• Download releases: https://pypi.python.org/pypi/scikit-learn
• Issue tracker: https://github.com/scikit-learn/scikit-learn/issues

Source code

You can check the latest sources with the command:

git clone https://github.com/scikit-learn/scikit-learn.git

Setting up a development environment

Quick tutorial on how to go about setting up your environment to contribute to scikit-learn: https://github.com/scikit-learn/scikit-learn/blob/master/CONTRIBUTING.md

Testing

After installation, you can launch the test suite from outside the source directory (you will need to have the nose package installed):

nosetests -v sklearn

Under Windows, it is recommended to use the following command (adjust the path to the python.exe program) as using the nosetests.exe program can badly interact with tests that use multiprocessing:

C:\Python34\python.exe -c "import nose; nose.main()" -v sklearn

See the web page http://scikit-learn.org/stable/developers/advanced_installation.html#testing for more information.

Random number generation can be controlled during testing by setting the SKLEARN_SEED environment variable.

Submitting a Pull Request

Before opening a Pull Request, have a look at the full Contributing page to make sure your code complies with our guidelines: http://scikit-learn.org/stable/developers/index.html

Project History

The project was started in 2007 by David Cournapeau as a Google Summer of Code project, and since then many volunteers have contributed. See the AUTHORS.rst file for a complete list of contributors.

The project is currently maintained by a team of volunteers.

Note: scikit-learn was previously referred to as scikits.learn.

Help and Support

Documentation

• HTML documentation (stable release): http://scikit-learn.org
• HTML documentation (development version): http://scikit-learn.org/dev/
• FAQ: http://scikit-learn.org/stable/faq.html

Communication

• Mailing list: https://mail.python.org/mailman/listinfo/scikit-learn
• IRC channel: #scikit-learn at webchat.freenode.net
• Stack Overflow: http://stackoverflow.com/questions/tagged/scikit-learn
• Website: http://scikit-learn.org

Citation

If you use scikit-learn in a scientific publication, we would appreciate citations: http://scikit-learn.org/stable/about.html#citing-scikit-learn

.

** 설치된 모듈의 위치정보 등 알아내기

    --  pip show  설치된모듈이름

TensorFlow on Windows: “Couldn't open CUDA library cudnn64_5.dll”

First of all, note that cuDNN is not distributed with the rest of the CUDA toolkit, so you will need to download it separately from the NVIDIA website. On Windows, it is distributed as a ZIP archive, so you must extract it and find the directory containing cudnn64_5.dll. For example, if you extract it to C:\tools\cuda, the DLL will be in C:\tools\cuda\bin\cudnn64_5.dll. Finally, you can add it to your path by typing the following at the command prompt:

C:\> set PATH=%PATH%;C:\tools\cuda\bin

C:\> python

...

>>> import tensorflow as tf

 I didn't have such issues with TensorFlow 0.12.1 (installed with pip install tensorflow==0.12.1):

---------------------------------------------------------------------------------

KNL

---------------------------------------------------------------------------------

matplotlib install  -  http://matplotlib.org/faq/installing_faq.html

> pip install matplotlib

or 

> git clone git://github.com/matplotlib/matplotlib.git

> cd matplotlib

> python setup.py install

> python setup.py develop

matplotlib test 

http://matplotlib.org/faq/howto_faq.html#how-to-search-examples

---------------------------------------------------------------------------------

konlpy install - http://konlpy.org/ko/v0.4.3/install/

> pip install --upgrade pip

> pip install JPype1-0.5.7-cp27-none-win_amd64.whl

> pip install konlpy

Binary Install

Ensure you have installed Anaconda/Miniconda. Instructions can be found here.

Install from the conda-forge software channel:

conda install -c conda-forge jpype1

$ pip install wheel

jpype  download : http://www.lfd.uci.edu/~gohlke/pythonlibs/#jpype

---------------------------------------------------------------------------------

JAVA_HOME 설정 

java 설치 - http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

환경변수 - JAVA_HOME  C:\Program Files\Java\jdk1.8.0_121

---------------------------------------------------------------------------------

To install this package with conda run: https://anaconda.org/anaconda/gensim

> conda install -c anaconda gensim=1.0.1

To install this package with conda run: https://anaconda.org/anaconda/scipy

> conda install -c anaconda scipy=0.19.0

---------------------------------------------------------------------------------

sklearn install

https://sourceforge.net/projects/scikit-learn/files/

sklearn test 

http://scikit-learn.org/stable/modules/generated/sklearn.model_selection.train_test_split.html

---------------------------------------------------------------------------------

Activate the conda environment by issuing the following command:

C:> activate tensorflow

 (tensorflow)C:>  # Your prompt should change 

예제 :: 

Saved model checkpoint to D:\PythonProject\cnn-text-classification-tf-master\runs\1490667625\checkpoints\model-1000

word2vec_example - https://gist.github.com/solaris33/8ce9913dea1aa4225876cbcfdd2963be#file-word2vec_example-py

Pycharm & tensorflow & Anaconda = http://yeramee.tistory.com/1

anaconda > tensorflow install : http://www.lfd.uci.edu/~gohlke/pythonlibs/#tensorflow

starting jupyter notebook

> jupyter notebook 

or 

> jupyter notebook --port 9999

5-1. 텐서플로우(TensorFlow)를 이용해 자연어를 처리하기(NLP) – Word Embedding(Word2vec) :: http://solarisailab.com/archives/374

jupyter notebook 사용하기 : http://goodtogreate.tistory.com/entry/IPython-Notebook-%EC%84%A4%EC%B9%98%EB%B0%A9%EB%B2%95

.