Download as PDF, PPTX
![import tensorflow as tf # Assuming TF 2.0 is installed
a = tf.constant([[1, 2],[3, 4]])
b = tf.matmul(a, a)
print(b)
# tf.Tensor( [[ 7 10] [15 22]], shape=(2, 2), dtype=int32)
print(type(b.numpy()))
# <class 'numpy.ndarray'>
You can use TF 2.0 like NumPy](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-38-2048.jpg)
![model = tf.keras.models.Sequential([
tf.keras.layers.Flatten(),
tf.keras.layers.Dense(512, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(10, activation='softmax')
])
For Beginners](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-44-2048.jpg)
![model = tf.keras.models.Sequential([
tf.keras.layers.Flatten(),
tf.keras.layers.Dense(512, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(10, activation='softmax')
])
model.compile(optimizer='adam',
loss='sparse_categorical_crossentropy',
metrics=['accuracy'])
For Beginners](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-45-2048.jpg)
![model = tf.keras.models.Sequential([
tf.keras.layers.Flatten(),
tf.keras.layers.Dense(512, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(10, activation='softmax')
])
model.compile(optimizer='adam',
loss='sparse_categorical_crossentropy',
metrics=['accuracy'])
model.fit(x_train, y_train, epochs=5)
For Beginners](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-46-2048.jpg)
![model = tf.keras.models.Sequential([
tf.keras.layers.Flatten(),
tf.keras.layers.Dense(512, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(10, activation='softmax')
])
model.compile(optimizer='adam',
loss='sparse_categorical_crossentropy',
metrics=['accuracy'])
model.fit(x_train, y_train, epochs=5)
model.evaluate(x_test, y_test)
For Beginners](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-47-2048.jpg)
![lstm_cell = tf.keras.layers.LSTMCell(10)
def fn(input, state):
return lstm_cell(input, state)
input = tf.zeros([10, 10]); state = [tf.zeros([10, 10])] * 2
lstm_cell(input, state); fn(input, state) # warm up
# benchmark
timeit.timeit(lambda: lstm_cell(input, state), number=10) # 0.03
Let’s make this faster](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-54-2048.jpg)
![lstm_cell = tf.keras.layers.LSTMCell(10)
@tf.function
def fn(input, state):
return lstm_cell(input, state)
input = tf.zeros([10, 10]); state = [tf.zeros([10, 10])] * 2
lstm_cell(input, state); fn(input, state) # warm up
# benchmark
timeit.timeit(lambda: lstm_cell(input, state), number=10) # 0.03
timeit.timeit(lambda: fn(input, state), number=10) # 0.004
Let’s make this faster](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-55-2048.jpg)
![model = tf.keras.models.Sequential([
tf.keras.layers.Dense(64, input_shape=[10]),
tf.keras.layers.Dense(64, activation='relu'),
tf.keras.layers.Dense(10, activation='softmax')])
model.compile(optimizer='adam',
loss='categorical_crossentropy',
metrics=['accuracy'])
Going big: tf.distribute.Strategy](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-59-2048.jpg)
![strategy = tf.distribute.MirroredStrategy()
with strategy.scope():
model = tf.keras.models.Sequential([
tf.keras.layers.Dense(64, input_shape=[10]),
tf.keras.layers.Dense(64, activation='relu'),
tf.keras.layers.Dense(10, activation='softmax')])
model.compile(optimizer='adam',
loss='categorical_crossentropy',
metrics=['accuracy'])
Going big: Multi-GPU](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-60-2048.jpg)
![# Load data
import tensorflow_datasets as tfds
dataset = tfds.load(‘cats_vs_dogs', as_supervised=True)
mnist_train, mnist_test = dataset['train'], dataset['test']
def scale(image, label):
image = tf.cast(image, tf.float32)
image /= 255
return image, label
mnist_train = mnist_train.map(scale).batch(64)
mnist_test = mnist_test.map(scale).batch(64)](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-62-2048.jpg)
![import tensorflow as tf
base_model = tf.keras.applications.SequentialMobileNetV2(
input_shape=(160, 160, 3),
include_top=False,
weights=’imagenet’)
base_model.trainable = False
model = tf.keras.models.Sequential([
base_model,
tf.keras.layers.GlobalAveragePooling2D(),
tf.keras.layers.Dense(1)
])
# Compile and fit
Transfer Learning](https://image.slidesharecdn.com/bradmiro-191029235720/75/Introduction-to-TensorFlow-2-0-67-2048.jpg)
Uploaded byDatabricks
Introduction to TensorFlow 2.0
The document provides an introduction to TensorFlow 2.0, highlighting its features, advantages, and use cases in deep learning, especially with complex, unstructured data. It outlines the transition to eager execution as default, the incorporation of Keras as a high-level API, and changes for both beginners and experts in model building. Additionally, it covers various utilities, transfer learning, and the importance of using deep learning selectively based on data size and structuredness.
More Related Content
Similar to Introduction to TensorFlow 2.0
![[DSC Europe 25] Ivan Peric - Intelligence Swarm Logic and Techno-Functional M...](https://cdn.slidesharecdn.com/ss_thumbnails/7my7c97fsduiccadgavw-2-251212103249-5a03f7c6-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Jovan Bogicevic - Legacy to AI-Driven Defense: Transforming D...](https://cdn.slidesharecdn.com/ss_thumbnails/rsarluadt563hntyfc8q-3-251211083849-3e7bc4c0-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Kaja Kandare - LLM as a judge.pptx](https://cdn.slidesharecdn.com/ss_thumbnails/arxyccaxsdsd1ba99wjw-7-251212104007-2b4e3f64-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Dunja Adzic Jovanovic - AI and Cybersecurity: Defending Data ...](https://cdn.slidesharecdn.com/ss_thumbnails/o1zylpbhrtwnixxq2xj8-7-251211083048-185086f6-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Miodrag Pesovic & Vladislav Radonjic - Federated Data Archite...](https://cdn.slidesharecdn.com/ss_thumbnails/gsbe3y5it5uhndi4e08e-1-251212103249-f1008e0c-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Jon Dajci - Bridging TradFi and DeFi: Building the Future of ...](https://cdn.slidesharecdn.com/ss_thumbnails/fqmhfvlbqhkihjvqvhmu-7-251211083849-6af7e325-thumbnail.jpg?width=640&height=640&fit=bounds)
![[DSC Europe 25] Dusan Nesic - Securing Tomorrow’s Infrastructure: Why Cyber-P...](https://cdn.slidesharecdn.com/ss_thumbnails/qikbszfftyowjm2q6duw-1-251211083848-8f2ead6b-thumbnail.jpg?width=640&height=640&fit=bounds)
Introduction to TensorFlow 2.0
- 1. Introduction to TensorFlow 2.0 BradMiro - @bradmiro Google Spark + AI Summit Europe - October 2019
- 2. Deep Learning Intro toTensorFlow TensorFlow @ Google 2.0 and Examples Getting Started TensorFlow
- 3. Deep Learning Doodles courtesyof @dalequark
- 6.
- 7. Examples of catsExamples of dogs
- 9.
- 15. You have lotsof data (~ 10k+ examples) Use Deep Learning When...
- 16. You have lotsof data (~ 10k+ examples) The problem is “complex” - speech, vision, natural language Use Deep Learning When...
- 17. You have lotsof data (~ 10k+ examples) The problem is “complex” - speech, vision, natural language The data is unstructured Use Deep Learning When...
- 18. You have lotsof data (~ 10k+ examples) The problem is “complex” - speech, vision, natural language The data is unstructured You need the absolute “best” model Use Deep Learning When...
- 19. You don’t havea large dataset Don’t Use Deep Learning When...
- 20. You don’t havea large dataset You are performing sufficiently well with traditional ML methods Don’t Use Deep Learning When...
- 21. You don’t havea large dataset You are performing sufficiently well with traditional ML methods Your data is structured and you possess the proper domain knowledge Don’t Use Deep Learning When...
- 22. You don’t havea large dataset You are performing sufficiently well with traditional ML methods Your data is structured and you possess the proper domain knowledge Your model should be explainable Don’t Use Deep Learning When...
- 24. Open source deeplearning library Utilities to help you write neural networks GPU / TPU support Released by Google in 2015 >2200 Contributors 2.0 released September 2019 TensorFlow
- 27. 41,000,000+ 69,000+ 12,000+2,200+ downloads commits pull requests contributors
- 28.
- 29. AI-powered data center efficiency Globallocalization in Google Maps Portrait Mode on Google Pixel
- 33.
- 34. Scalable Tested at Google-scale. Deployeverywhere Easy Simplified APIs. Focused on Keras and eager execution Powerful Flexibility and performance. Power to do cutting edge research and scale to > 1 exaflops TensorFlow 2.0
- 35.
- 37. TF Probability TF Agents Tensor2Tensor TFRanking TF Text TF Federated TF Privacy ...
- 38. import tensorflow astf # Assuming TF 2.0 is installed a = tf.constant([[1, 2],[3, 4]]) b = tf.matmul(a, a) print(b) # tf.Tensor( [[ 7 10] [15 22]], shape=(2, 2), dtype=int32) print(type(b.numpy())) # <class 'numpy.ndarray'> You can use TF 2.0 like NumPy
- 39.
- 40. What’s Gone Session.run tf.control_dependencies tf.global_variables_initializer tf.cond, tf.while_loop tf.contrib What’sNew Eager execution by default tf.function Keras as main high-level api Specifics
- 41.
- 43. Fast prototyping, advancedresearch, and production keras.io = reference implementation import keras tf.keras = TensorFlow’s implementation (a superset, built-in to TF, no need to install Keras separately) from tensorflow import keras Keras and tf.keras
- 44. model = tf.keras.models.Sequential([ tf.keras.layers.Flatten(), tf.keras.layers.Dense(512,activation='relu'), tf.keras.layers.Dropout(0.2), tf.keras.layers.Dense(10, activation='softmax') ]) For Beginners
- 45. model = tf.keras.models.Sequential([ tf.keras.layers.Flatten(), tf.keras.layers.Dense(512,activation='relu'), tf.keras.layers.Dropout(0.2), tf.keras.layers.Dense(10, activation='softmax') ]) model.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['accuracy']) For Beginners
- 46. model = tf.keras.models.Sequential([ tf.keras.layers.Flatten(), tf.keras.layers.Dense(512,activation='relu'), tf.keras.layers.Dropout(0.2), tf.keras.layers.Dense(10, activation='softmax') ]) model.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['accuracy']) model.fit(x_train, y_train, epochs=5) For Beginners
- 47. model = tf.keras.models.Sequential([ tf.keras.layers.Flatten(), tf.keras.layers.Dense(512,activation='relu'), tf.keras.layers.Dropout(0.2), tf.keras.layers.Dense(10, activation='softmax') ]) model.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['accuracy']) model.fit(x_train, y_train, epochs=5) model.evaluate(x_test, y_test) For Beginners
- 48. class MyModel(tf.keras.Model): def __init__(self,num_classes=10): super(MyModel, self).__init__(name='my_model') self.dense_1 = layers.Dense(32, activation='relu') self.dense_2 = layers.Dense(num_classes, activation='sigmoid') For Experts
- 49. class MyModel(tf.keras.Model): def __init__(self,num_classes=10): super(MyModel, self).__init__(name='my_model') self.dense_1 = layers.Dense(32, activation='relu') self.dense_2 = layers.Dense(num_classes, activation='sigmoid') def call(self, inputs): # Define your forward pass here, x = self.dense_1(inputs) return self.dense_2(x) For Experts
- 50.
- 51. Symbolic (For Beginners) Yourmodel is a graph of layers Any graph you compile will run TensorFlow helps you debug by catching errors at compile time Symbolic vs Imperative APIs
- 52. Symbolic (For Beginners) Yourmodel is a graph of layers Any graph you compile will run TensorFlow helps you debug by catching errors at compile time Imperative (For Experts) Your model is Python bytecode Complete flexibility and control Harder to debug / harder to maintain Symbolic vs Imperative APIs
- 53.
- 54. lstm_cell = tf.keras.layers.LSTMCell(10) deffn(input, state): return lstm_cell(input, state) input = tf.zeros([10, 10]); state = [tf.zeros([10, 10])] * 2 lstm_cell(input, state); fn(input, state) # warm up # benchmark timeit.timeit(lambda: lstm_cell(input, state), number=10) # 0.03 Let’s make this faster
- 55. lstm_cell = tf.keras.layers.LSTMCell(10) @tf.function deffn(input, state): return lstm_cell(input, state) input = tf.zeros([10, 10]); state = [tf.zeros([10, 10])] * 2 lstm_cell(input, state); fn(input, state) # warm up # benchmark timeit.timeit(lambda: lstm_cell(input, state), number=10) # 0.03 timeit.timeit(lambda: fn(input, state), number=10) # 0.004 Let’s make this faster
- 56. @tf.function def f(x): while tf.reduce_sum(x)> 1: x = tf.tanh(x) return x # you never need to run this (unless curious) print(tf.autograph.to_code(f)) AutoGraph makes this possible
- 57. def tf__f(x): def loop_test(x_1): withag__.function_scope('loop_test'): return ag__.gt(tf.reduce_sum(x_1), 1) def loop_body(x_1): with ag__.function_scope('loop_body'): with ag__.utils.control_dependency_on_returns(tf.print(x_1)): tf_1, x = ag__.utils.alias_tensors(tf, x_1) x = tf_1.tanh(x) return x, x = ag__.while_stmt(loop_test, loop_body, (x,), (tf,)) return x Generated code
- 58.
- 59. model = tf.keras.models.Sequential([ tf.keras.layers.Dense(64,input_shape=[10]), tf.keras.layers.Dense(64, activation='relu'), tf.keras.layers.Dense(10, activation='softmax')]) model.compile(optimizer='adam', loss='categorical_crossentropy', metrics=['accuracy']) Going big: tf.distribute.Strategy
- 60. strategy = tf.distribute.MirroredStrategy() withstrategy.scope(): model = tf.keras.models.Sequential([ tf.keras.layers.Dense(64, input_shape=[10]), tf.keras.layers.Dense(64, activation='relu'), tf.keras.layers.Dense(10, activation='softmax')]) model.compile(optimizer='adam', loss='categorical_crossentropy', metrics=['accuracy']) Going big: Multi-GPU
- 61.
- 62. # Load data importtensorflow_datasets as tfds dataset = tfds.load(‘cats_vs_dogs', as_supervised=True) mnist_train, mnist_test = dataset['train'], dataset['test'] def scale(image, label): image = tf.cast(image, tf.float32) image /= 255 return image, label mnist_train = mnist_train.map(scale).batch(64) mnist_test = mnist_test.map(scale).batch(64)
- 63. TensorFlow Datasets ● audio ○"nsynth" ● image ○ "cifar10" ○ "diabetic_retinopathy_detection" ○ "imagenet2012" ○ "mnist" ● structured ○ "titanic" ● text ○ "imdb_reviews" ○ "lm1b" ○ "squad" ● translate ○ "wmt_translate_ende" ○ "wmt_translate_enfr" ● video ○ "bair_robot_pushing_small" ○ "moving_mnist" ○ "starcraft_video" More at tensorflow.org/datasets
- 64.
- 67. import tensorflow astf base_model = tf.keras.applications.SequentialMobileNetV2( input_shape=(160, 160, 3), include_top=False, weights=’imagenet’) base_model.trainable = False model = tf.keras.models.Sequential([ base_model, tf.keras.layers.GlobalAveragePooling2D(), tf.keras.layers.Dense(1) ]) # Compile and fit Transfer Learning
- 68. Image of TensorFlowHub and serialized Saved Model
- 69.
- 70. Migration guides tf.compat.v1 forbackwards compatibility tf_upgrade_v2 script Upgrading
- 72.
- 73.
- 75. Intro to TensorFlow forDeep Learning Introduction to TensorFlow for AI, ML and DL coursera.org/learn/introduction-tensorflow udacity.com/tensorflow New Courses
- 77.
- 78. Go build. pip installtensorflow tensorflow.org
- 79. tf.thanks! Brad Miro -@bradmiro tensorflow.org Spark + AI Summit Europe - October 2019
- 80.