Microsoft Azure Training - [39] Azure Storage - Part 2 - BLOB Storage

hi everyone you are viewing cloud
Rangers Microsoft is your training I am
Sean a smelly Microsoft Azure MVP and
today it's going to be part two of the
is your storage series where we are
going to talk about blob storage in
particular and I'm going to touch over
some security stuff with cloud storage
as I go to blob storage as you see later
how some of these things are related
that's my contact information down there
my email Twitter blog LinkedIn YouTube
as well as the slides will be available
at SlideShare Nate /on as well after I
upload this video so you can get all my
slides in that location a lot of people
still keep asking through email with the
slides are that's where the slides are
alright so let's get started so we could
talk about in more specific from part
one the blob storage in the last series
we discussed all type of storages and
today it's a full session on blob
storage and some security stuff so in
short what if what is a blob storage a
blob storage or binary large objects
it's any type of file or binary data
storage for storing uninstructed data
and by that uninstructed
I mean like documents images videos log
files even virtual machine discs or the
VHDs so any file that you can sort of
think of is actually a blob storage when
it comes to the type of data in Azure
okay it will start making more sense as
we go through some of the demo of the
type of files that you can put in there
but just remember as long as it's not
structured and it sounds structured its
most likely a blob so a question might
come what is a structured data well
think about it a structured data might
be like sequel data it's a structure it
has schema there is grammar and
properties of that database there's
metadata on that data so those are what
structured data are but when you talk
about random data like your files like
images pictures videos log files on your
server those are on its structure
because you can put you know all data
together it does not matter
how large these files are they can be of
different sizes different names they can
be all different kind of files in
different folders subfolders so there's
no structure there so that's what it
really means when it says unstructured
data okay so now a blob can be accessed
and in the last video we talked about
through URLs or you a blob storage can
be accessed by endpoints and the way
blob storage are exposed are how its
sales over here is HTTP the account name
or the storage name over here and blob
court windows net and you can have a
forward slash and you can actually go
and see the blob in there and I'll go
through that in the demo as well that
this is how your blob is exposed out to
be a little bit careful and I say this
is how it's exposed because there are
things like private data and public data
and how your blob is actually exposed
outside so we'll get to that when we
come to secure eight so one concept I
want to introduce with blob data and
it's probably one of the most important
is containers and the way you have to
remember there's a lot of details on
what containers are but it's actually
very simple containers are like folders
so in Azure storage when you create a
container you're creating some sort of a
folder it's not really a folder but it's
like a folder okay
and bunch of blobs can be stored in a
container just like how you store files
in folders right so if you have a file
with the subfolders or you know with
multiple files in there that's how one
container is a folder okay so think
about it the way this container will
work so let's say I have a file called
my notes
txt that's the blob type okay so this is
a blob end of the day it's like a file
well it is a file so the way containers
would come to picture over here is that
we know that this is how your blob is
exposed now we create a container let's
say my containers name is my container
so it's just like this a folder and my
notes start txt so this is how the
container actually holds this blob okay
so it's like a folder holding this file
nothing different just think of it like
that and it will be very simple okay
before I get into much more into the
blob storage and go through demos and
everything I want to touch a little bit
on the security this is not the entire
security when it comes to storage or as
you're in general the reason will be
very apparent after I explain this okay
and security is quite vital when it
comes to any cloud services because the
whole take out there well it was for a
while was that you know how secure cloud
is or your data is so let's get into
some security stuff so as your storage
security by default all requests to an
azure storage account require
authentication what I mean by that is
that when we go and create a storage
account like we did in my last session
and we created blob or you know we
create anything in that storage upload
data or create a VHD file by creating a
virtual machine we keep going to the
storage account that we see everything
right in there okay actually that's not
true the storage account is an entity by
itself and it requires authentication
and as your portal does not application
because you are the owner so it passes
that to - your storage account and it
almost seems like it's simplest that you
can just go into your storage command
come out and do all that in the backend
actually there is some authentication
that is taking place and as you're
programmatically generates the primary
and secondary access key when you will
create a storage account and I briefly
showed that in the last video and I'm
going to show you this access keys in
this station as well what is located and
how to get that because we'll see that
this is going to turn out to be pretty
important okay
the way you get the storage key once
your storage account is created is by
get as your storage key if you are
trying this with PowerShell okay you put
in your storage account name let's say
my storage account name was ranger store
1 2 3 it will go and give you your both
primary and secondary key ok if you want
to create a key either primary or
secondary and the reason you would
actually do that is because if you
wanted to change the key the way you do
that is
new Azure storage key the key type here
I'm changing the secondary key storage
acronym as this okay so just remember a
couple of things one when you create a
storage account as you're
programmatically will generate the
primary and secondary access key for you
nobody knows it think of this as a key
your password okay you need to access
your storage somehow that's how you do
that or the portal it does not matter
because as your is doing that for you
but if you try to do this through a code
through PowerShell to do a lot of stuff
you have to know your keys and the
second thing you have to remember is if
you want to reset this key to something
else because you thought that it got
compromised or whatever you can use the
new as your storage key command late to
actually generate a new one for you okay
so the next thing pretty important for
your exam as well is that the access
Keys offer full admin access to the
storage so when you go to your Azure
portal since it's already using the key
in the backend for you
you have full admin access you can see
anything that's there in your storage
account okay you can download it delete
it you can move it around do whatever
you need to do because it gives you full
admin access in fact when you're in
PowerShell and you put in your key and
you're trying to do any you know
operations on your blood storage for
example we'll do that in this session
today you'll see that you have full
admin access because you can do anything
and this creates a little bit of a
problem and frankly you know full admin
access is not the way to go if you're
going to use storage for other things
where you're giving other users access
to your storage through some sort of a
coder program to do something and that's
why we have editor as your store
security thing it's called shared access
signature SAS I'm not going to get too
much into this this is more of a
development realm of a thing you can go
to Microsoft's technique look much it
more into it but the way shared access
signature or SAS works is that you can
grant access to clients that should not
have full access means you are not going
to give them full admin access to your
storage so you create an access
signature this is actually like an
authentication mechanism okay in the
back end that's what is going on it's
authenticating you through different
means that's all I'm going to say to
actually give you access to the storage
and it's also
can be time to base access okay so you
can say that I want to give this person
or this client access only for a couple
of days couple of hours so it will pass
a token that will only be you know won't
it be valid for a couple hours or it
will be time based means it expires okay
and says that says you are a what you
generate the you are a and that's how
they will access that and there's a lot
more details to when it comes to
development with as your SDK and shared
access signatures one way you can do
that when the application does not
require full access to it alright so
let's move on so we are back to blob
storage containers okay so let's go into
a little bit more details on how to
create a container and different kind of
access that are there on the containers
so to create a storage container
obviously the first thing you need to do
is have a storage account created once
your storage account is created you go
in there and try to create a storage
container there are only two things that
are required for you to create a
container is the name of the container
and the level of access the level of
access is kind of the ACL of folders so
it's similar to I mean in in context of
folders that's what it would be ACLs in
containers you have three access
policies one is private which is by
default so if you create a container
today by default it will be private it
can only be accessed by the storage
account owner you can access it to the
portal through PowerShell with your
access keys but that's all you get okay
and then you have public blob which is
public read access to blobs in the
container and you have public container
which is allows public read access to
the full container so the difference
between public blob and public container
is both of them allow read access but in
public blob
you have no way to list the other blobs
in the container so you do not have the
listing access in that folder if you
think of Windows Server kind of thing so
you can if somebody tells you that this
is the blob you can access it through
the URI and go and be like okay this is
how I'll access it because it's public
but there's no way for you to see what
else is there with public container
access you have full read access as well
as access to the full container you have
the metadata of the container it tells
you how this container what this
container is
all the blobs in the container will be
listed as well and I have a little bit
of a PowerShell over here to create a
storage container and the way we are
going to do this is that let's go in to
one of the demos where we will create a
storage account and we list create a
container both through the portal as
well as to PowerShell all right so let's
get going alright we are here in my as
your session or my azure portal here
logged in as you can see under all
resources there's nothing there let's go
ahead and create a storage account so
let's go to new by the way as your
portal which is portal that as your
comments come out of preview it has been
on preview for a while like months or a
year and now it's out so if you are
using the old portal which is managed
Windows Azure comm you should probably
start using this using this portal so
all my videos most of them thinks most
of the sessions right now are in this
portal because as you're supporting most
of the stuff here so let's go ahead and
create a storage account or you can come
up here go to data store and create a
storage account from here okay so let's
go create one for the deployment model
I'll keep it as classic for now as we
know from the previous session that this
has to be something unique so let's call
it Ranger store one two three most of my
demos are going to be here it has to get
unique name by the way so if you don't
get this check box here means that it's
not unique because this is going to be
publicly available through a public DNS
so you have to be unique I will just do
locally redundant because it's going to
be the cheapest option right now for
this demonstration purpose I'm not too
worried about hive lip lady I want to
just put it in a resource group Ranger
resource group 1 and let's put it on a
region so your storage account is based
on your region and let's go put it in
I'm going to put it in central us for
now let's do that pin to dashboard let's
do create already it is creating the
it's creating the Azure storage account
so once that's created I'll be right
back okay took a couple of minutes but
it's there
let's go to all resources and I should
see Ranger store one two three it's in
central us I have created this a storage
account okay once we create this a
storage account let's go in there and
there are a couple of things I want to
show you here it shows what's the
resource group it's in its available the
type of storage is standard locally
redundant storage and it shows you the
services which is like the blobs which
we are talking about right now files
tables and queues that you can also see
there so a couple of things I want to
show you here to start off with let's
start looking at the keys the security
stuff I was talking about so this is
storage account when it got created it
created the primary and secondary key
here so this is the primary access key
you can copy it from here or this is the
secondary access key connection is doing
it as it actually gives you a little
connection straight if you want to use
your application to connect to it
directly and it's a primary connection
estrange secondary connection and string
it takes this access key so the reason
there's a primary access key and
secondary access key is you can use
either of them to access your storage
okay
the only reason they have both is it
gives you a way to do some sort of fault
tolerant or hive liability
so for example if it's using a primary
access key and you want to regenerate
one you can still use the secondary
access key till then till you have
regenerated the primary access key or
have changed that okay so that's why
they are both of them in the backend as
your portal when we come over here and
we are looking at all this stuff it has
already authenticated us with this case
that's why you can see everything the
same is not for PowerShell and I will
show you in PowerShell you can just
access your storage account you need to
pass the primary access key or secondary
access key to actually go ahead and get
that but I wanted to show you over here
the storage account already
the key created for you now let's go to
blobs that's what we are dealing with
right now when I click on blob right now
you can pretty much show me just nothing
really it just shows that this is the
storage account this is the service
endpoint so you know ranges to 1 to 3
which is account named blob quarter
windows.net
it's available it's storage subscription
ID but as you can see over here low
containers found you don't have any
containers yet ok so let's go and create
a container it's going to be very simple
I go to container here and I go and type
new container for example it's just like
a folder name and this is access type by
default as you can see it's private and
then you have blob and containers so
this blob is like the one that I was
talking about public blob and public
container they remove the public from
there but if you made it blob over here
it would be pretty much public blob and
if you do container here everybody will
have full access to the container so by
default I'll keep it private I don't
want people to access this through the
uri yet and let's see actually it can
only be lower case my bad let's do a new
container it does not like that camel
notation you can see it got a checkmark
over here create and it will create the
container and the container you can see
got created over here takes couple of
seconds to create really and there is no
blobs in this container ok
access policy it should be private so we
can change that here in the future if we
really need to their properties they're
deleting things and everything else over
here so you can actually store blobs in
here right now I'll show you how to
upload blobs to Azure in a bit but this
is where you would come and do it let's
see what else we notice here let's go to
the properties here in the properties it
actually shows you how to get to this
container so you can see new container
this is how you do that with the URL
grand gesture last modified everything 0
0 0 there's nothing really here and you
can delete that from there as well so
that's how you create a container in
blob services from the portal so let's
try to do this for PowerShell and I
do have everything ready over here so
let's go and create a new as your
storage account I know we already
created one over here so when you come
to all resources we have Ranger store 1
2 3 that's a storage account I will go
through the entire process ok so I just
want to show you the entire whole thing
created a storage account create a
container and everything else I hope you
can also see that somebody actually
emailed me saying that the screen was
too small and that they had a hard time
saying this so I increase this 225
percent so you should be able to say
this the screen okay so let's go ahead
and create a new storage account like a
brand new one and the way you do that
over here I don't want to run the whole
script I just want to run this line so I
can either highlight this and click over
here run selection on the top and if I
want to run the entire script out I've
done this okay the other way instead of
highlighting it if you put it at the end
of the statement over here and do run
selection you don't have to select it it
will only do this one but be careful
very careful when you do that yeah a lot
of things can happen when you and when
you don't know what you're doing here
and you run a script get to a lot of
damage so anyways I'm gonna run this one
like this run selection and we'll create
a storage account called Ranger store
1 2 3 same electric mat last one but
this is from PowerShell so I put PS at
the end over here let's go create that
it takes a little bit of time to create
that so I'll pause and come back
alrighty so the storage account was
created let's go and verify that go to
all resources here I should say Ranger
store 1 2 3 PS ok so it was created now
let's go back here get storage account
so I'm showing you different partial
command lights that are available to you
to operate on the storage account so get
a storage account will actually show you
both the accounts that we have right now
in this subscription so it'll be
interesting I have one register 1 2 3
and then I have Ranger store 1 2 3 PS
it's showing all the endpoints over here
so you could use this to just access the
blob then you have queue file which we
are not using it to do all that ok up
let's click the screen now I want to
show you the PowerShell
way to actually view your access key so
the way you do that is get as your
storage key storage account name and you
need to put the storage account name to
get that specific storage account key so
when we want to see that storage account
key for Rangers 2 1 2 3 PS which you
just created it's showing you the
primary and secondary ok showing that
storage account name and all that so if
you change that to a storage account 1 2
3 just like that this is a different
storage account so you'll obviously
notice that it has different access key
they don't match right because they're
two separate storage accounts
it's a nice thing now I want to show you
something very interesting here what if
you were to regenerate a storage account
key because one got compromised or
whatever let's say the secondary storage
key got compromised so let's go ahead
and run get a storage account key so
this is the primary and secondary key
for the PS register PS at storage
account this is the key for the
secondary one and I want to change that
so the way you do that is new as your
storage key the key type is secondary
because this is the secondary key and
the storage account name is Ranger store
1 2 3 PS so let's go ahead and do that
and one it's once it's done it will
display the storage king and I want to
show you the first one the primary we
did not change that so it is the same so
it's said J equals to R equals over here
the same over here but obviously now if
you see the secondary key it got changed
this one starts with G Q this one is Q V
and you can see the storage account key
got changed okay that's pretty cool so
let's go ahead and create a container
using partial so the way you do that is
like I mentioned in the portal the
authentication for the storage account
is being done for you by a sure but in
PowerShell that's not the case so the
first thing you need to do is make sure
you know the key or you get the key okay
so usually it's very I mean you can
always go and get the key and create the
command lit that way I want to be a
little bit more dynamic so what I did is
I'm using this room get as your a
storage key register 1 2 3 PS dot
primary so I'm getting the primary key
first with this command let so if you
run this just by itself you will see it
will give you the primary key
I'm taking that key and storing it in
the store key variable all right so now
I have access to the key the primary key
I'm taking that and I'm creating
something called as a as your storage
context so as your storage context means
basically it gives you the context of
the storage account in simple terms it
means which account do you want to
operate on that's all it's doing okay so
I'm creating a new context and I'm
saying the storage account name is going
to be ranger store 1 2 3 PS okay and the
account key is this is the key the key
that we had you know retrieved earlier
so I'm basically saying I want to work
with the Ranger store 1 2 3 PS and I
have the key take that key and that's
the account I'll work on and I'm going
to store this information in store
context means I'm going to grab the
storage account okay so let's go ahead
and run that ok now we have the context
means which we know which again we want
to work on we have the permission
because we had gotten the key and now we
are going to create the container with
this command let new as your storage
container and like I mentioned that you
know all you need is a name and the
access of the permission so the name is
my PS container that's what we're going
to call it and I would give the
permission as container or public
container means full access to the
entire container to even see all the
blobs and everything else in real life
you probably want to do this as private
for your purpose of things here I just
want to show you what you can do here
and the context means which account do
you want to work on well this is the
storage account I want to work on and
that's the variable I'm going to pass
over there okay so let's go ahead and
create the container it's created the
container the way we can actually see
that is one from the portal so let's go
create a hit on this storage account go
to blobs and see what we see there we
should see that container created there
ok my PS container it's created perfect
the other way you can view all the
containers is get as your storage
container again pass the
context so anything you do in PowerShell
right now on that storage account has to
have that context means it has to hold
to that storage account so we say that
get get it for this a storage account so
let's run this my PS container so we
have created one cool so we went and
used PowerShell to create a storage
account get the storage key create a
context means got ahold of the storage
account and now we created a container
there in the storage account okay now
let's move on to the slides and I'll
show you some interesting stuff I'm
going to show you some powershell
commandlets to partial command let's to
show you how to access your storage in
different ways we have I mean I just
showed you in in the portal as your
portal how you could go and view
everything but I will show you how to
upload file download file doing
everything from PowerShell and that's
those are the scripts okay so I'm not
gonna waste too much time explaining
over here let's go jump right into the
demo all right so these are all the
scripts that we are going to work on is
the same thing I took from the slides so
except that I have the storage cap name
over there ranges from 1 to 3 but it's
register 1 to 3 PS over here so the
first thing we want to do is get that
storage context like I mention and I
keep this tracing on that that you need
to get hold of the storage account and
the way you do that is first get the key
of the storage account to this one and
you create the context so now we know we
have a hold under storage and we can do
everything else over here so we ran this
command late in the previous when the
last time when I will show you demo new
staff
so let's go and click on this it's
actually showing you the container that
we have get a storage container
okay now let's upload a file from your
local computer to the storage account
and the way we are going to do that is I
already have a text file here so to take
the folder in my temp folder I have a
folder called is it copy txt one it's
just a basic text file ok this is
actually a blob in a container on Mike
pewter it's a file in a folder but in
Azure storage it will be called a blob
and we know a blob can be a file so
let's go ahead and upload this to the
storage account if I come over here go
to PS container we know there is nothing
here no blobs found because nothing is
there let's upload something this guy
the way we will do that is set as your
storage blob content okay so we'll take
we'll take some content and we are going
to put that in Azure storage blob the
context is this one which we stored from
here this is the storage account the
container is my PS container which we
know we created over here my PS
container right and we are going to
store the file see temp is e copy txt
and dot txt let's go ahead and upload
that run the command late depending on
the size of your file this is one day
nine KB so you can see the length is
nine
yeah it's about well one KB sorry that's
the length over there and if you come
over here refresh this you can actually
see the file is already uploaded here so
that's how you'll upload a blob inside a
blob container you can do stuff with the
file over here obviously if you click on
that it tells you the file it says it's
nine bytes which is roughly about one KB
and it says all the stuff you can do
over here this is how you will access
this file so if you remember and let's
try this out right now let's actually
copy this if I put this over here I
should be able to see some text the
reason this is working if you remember
is because in my PS container when we
are creating that we made it public
container so people should be able to
access this from anywhere if this was
private there was no way we could read
this file just using this URL in fact
anywhere in the world people can access
this file to this URL right now by the
time you're probably watching this video
I might have deleted this so you might
not be able to but if you try from
different computer at this time people
have access to this great way to share
file to Microsoft Azure storage by the
way and the other thing is it was opened
so everybody has it
let's try this obviously you cannot go
to 404 Container you cannot see anything
in there but you can list with other
tools and get everything in that
container because it has public access
policy with public container access so
that's how you'll actually upload the
file to upload the file to a blob
storage container okay let's see what is
there in the container rather than going
from the portal you can use a command
let get as your storage blob this is the
storage context and container my PS
container so we want to see what's there
in that container using PowerShell so if
we take on this it actually shows you is
a copy it actually shows you this file
through this PowerShell command it's a
great thing to do okay let's go ahead
now try one more thing I'm going to
delete this file okay so the only place
I have this file is right now in my
azure storage how do you download this
file the way you download this is first
you get hold of the blob so let's
actually get that get as your storage
blob this is the storage container my
container and name if you run this by
itself you'll see it will just give you
the name of the blob okay great let's
store that blob dem over here now I'm
going to run this command let called get
as your storage blob content so if you
remember over here this was set as your
storage blob content this is get as your
storage blob content so I'm just saying
go get me this blob and it's this a
storage cup text this container blob is
blob so we know the name and the
destination is C temp so if we run this
right now depending again on your file
size go over here it should have
downloaded this great very simple so we
have now uploaded file using PowerShell
downloaded file using partial as well
let's go ahead and delete that from the
blobs okay so get as your blob my
container we know this file is still
there
oops sorry we know this file is still
there let's delete it the way you delete
it is remove as you're a storage blob
this is the context this is the
container and this is the blob name I
could have used dollar blob over here I
just get the full name let's try that
if we do a gate as your storage blob
right now we should see nothing in there
as expected it's all gone let's refresh
this it's all gone
great this is very very simple I mean it
can't get any more simple than this once
you have learned the context of
different I mean you have learned the
the concepts of that zero storage all
right this is pretty simple but I'm
going to show you one more industry
specific kind of stuff that we use when
we're doing work in different
organizations different tools that can
actually make this way more simpler for
you but before I do anything I'm going
to show you one more thing in the power
show I mean in the portal over here I'm
going to actually create a virtual
machine and show you something very
interesting so we know we have two
storage accounts they're my store ranges
to 1 2 3 and register 1 2 3 PS in
register 1 2 3 let's go create a VM so
compute because this is something you're
most familiar with right I mean you
should be able to do this like Dobie
Gale let's make a classic version
machine by the way I keep doing classics
so there's two deployment model classic
and resource manager someday I'll
probably have a video it's kind of
showing you the difference between the
two in most organizations new virtual
machines we are creating through
resource manager obviously so let's call
it my Ranger VM one hopefully that's
going to be unique username password
let's go make this nice and easy
let's view all I'm picking the size
right now and in the size I'm going to
probably pick on something nice and
cheap just a very small dipper so
yeah in one standard should do it I'm
not really going to log into it so
alright so standard in one let's scroll
down a bit optional configuration so
let's go here in optional configuration
I want to actually choose my storage
account because by default it tries to
give you everything for a new virtual
machine but I want to be a little bit
more precise and I would have say that I
do have couple of storage account so I'm
going to use the Ranger store one two
three not a random one that has your
credits for me
okay so range is two one two three I'm
going to leave everything else than when
it is cool Central USA no big deal
I'll be back want this once this is
created okay alright it's taking a while
to create the virtual machine but we
should be okay to demonstrate this part
so let's go to all resources here and
alright so you can see it's creating
this virtual machine right now classic I
could go to our storage that's what we
are interested in Rangers two one two
three this is very important to know
anytime there's a virtual machine
created like I said in my previous
session anything related to storage
stays in a storage account so anytime
there's a virtual machine created the
VHD file is actually a blob so if you go
to the blobs here you should see that it
will create a container always the same
container VHDs okay virtual hard disks
let's go in there and you should see the
VHD files in here this is the one okay
this is the VHD file it's 127 cakes so
anytime a virtual machine is created the
disk the VHD file is technically a blob
that will be created in the storage
account under the container VHDs so in
enterprises we try to keep the VHDs
together so we will always have that
same storage account for a certain
location and we'll store the VHDs
together so if you have more virtual
machines then start showing up with v h
dot v HD r dot status files for the
virtual machines here
so I just wanted to show you that what
it is about and also to show you that
VHD files are actually blobs and we have
been working with Vedas forever when we
are creating virtual machines for other
sessions okay so this is pretty cool
let's go ahead and I'm going to go to
the next slide this slide is pretty
interesting so we have used the Perl do
you do storage operations we have used
PowerShell to do storage operations I'm
going to show you some nice tools we use
in the industry to do a bunch of stuff
really quick really efficient it's also
done by Microsoft so it's great okay the
first one is called is it copy or AZ
copy depending on where you live and you
can download that from here from
Microsoft site here download is a copy
and I'm going to show you a demo of what
you can do with that so I already have
that downloaded here
so I've downloaded and installed here
and once you have done that I have put
that in my Start menu over here so run
as appreciator it'll look like this
little blue thing over here
okay you can do a bunch of operations
here so let's do easy copy it when you
when you just run it by itself it shows
you what it is what it can do if you
have to see some specific commands you
can do this it shows you all the
commands of all the things that you can
do with AZ copy all right cool let's do
something interesting with is a copy so
let's go to our storage account and
everything you can do with a Z copy can
also be done by PowerShell but I'll show
you why sometimes AZ copy is much more
easier to use for certain things okay so
let's go to the blobs here in my Ranger
store 1 2 3 PS I will just use just 1 2
3 PS it's nice and clean that's not a
whole lot going on in there so I'm going
to go and let's see did we have a file
in here my PS container ok in my PS
container
there's no blobs found there's no blobs
ok so let's go ahead and
load this file using AZ copy and the way
you would do that it's very interesting
and easy as well there's a copy you give
it a source for now I'm going to just
say take entire contact of the temp
folder so if more than one folder you
can actually do the whole thing and
should let me show you that let me do
text one just one save I'll show you you
can upload the entire folder using AZ
copy we just want commitment destination
so the way you do the destination is
pretty much put that URI
so let's cheat a little bit here I'm
going to go and do this one
I just want the endpoint so I'm saying
that this is going to be where things
are going to be copy/paste and we know
that my PS container is the container
where we want this okay now this is the
thing you still need the key so the way
you put that is the destination key okay
let's go get the key how do you get the
key well we had a command plate over
here that will get our key our primary
key you can also go to the portal and
get that from there
I'm just try to do it cool it here paste
it here so I'm taking the entire content
of the temp folder using this is a copy
tool and I'm going to upload them to the
destination which is Rangers two one two
three
using the URI at the destination key
let's hit enter it actually tells you
total files to be transferred was too
successful in - if I come over here
refresh that I can do that so as you can
see rather than going one file by one I
mean of course you can do creative stuff
with PowerShell and get the entire
folders content uploaded in a decent way
but I just wanted to show you that easy
copy can do this in a much easier way ok
now I'm going to show you something
really cool and this is the value I try
to provide you to show you interesting
things that you can do with with with
Azure and we do this in real life
scenarios at work all the time all right
let's say my destination was actually
one storage account obviously and my
source was not my local computer but it
was another storage account as well I'll
give you a very good reason why you will
need to do that so let's see over here
this is real life it's tough guys I mean
you might be already doing this in your
organization or other places so we're
going to take some content from Rangers
- 1 2 3 PS and we're going to move it to
this a storage account ok so let me get
the
here you can obviously do this impartial
it's a little bit more complicated but
this is where easy copy comes in and
great anyway so let's do this
I am going to say the source type
properly it's going to be what the
source is going to be Ranger store PS
over here okay it's the source and in
here it is going to be the container
what's the container name by PS
container my PS container already and
what is my destination I'm saying my
destination is going to be another
storage account so let's actually try
this Ranger store 1 2 3
we know Ranger store 1 2 3 is going to
be actually that's the key I need the
URI which is actually pretty much
similar to this one right so let's try
that register 1 2 3 URI remove that make
sure this is correct I need that name of
the container
I forgot the container name here I think
it was called my container I will use
one of the default containers here new
container ok so I'm going to put this a
new container already now we need the
source key we need key for both this
people right and we both this containers
here so the source key was going to be a
ranger store PS so let's try that I'll
take the public key of this guy you need
that for that occasion
always remember that without putting
this it's not going to work out so
source key is going to be passed here
and destination key we need this time a
destination key right because we are at
this time I mean we knew the destination
key throughout the destination system we
just added the new thing which was the
source key so destination is what
destination is my PS account I mean not
non PS account so let's do this one over
here
so basically taking the storage key for
both this guys so I have access having
this keys really mean that what does it
mean it really means that we are we have
access to this keys otherwise people
will be able to without this key just
come in your storage and do whatever
they want can you imagine your VHDs are
actually public and people can come into
whatever they want without having this
keys okay so the pattern so this is how
we want to say that the file name that
we want so you can put a pattern here or
I can just put the file name correctly
so we are trying to get what we are
trying to get let's move is a copy txt
file okay let's try this one oh let's
hope this works so get it as your blob
PS container so I know in my new
container right now there shouldn't be
any plug this is my range restore one
two three but in my ranger store PS I
know there are these two files and I'm
moving this file from Ranger store 1 2 3
PS to Ranger store 1 2 3 moving from one
storage account to another storage
account let's see if this works transfer
completed successfully so if I come over
here do this I should see a copy guys
this is very very important
I just used easy copy to just move one
file from a storage account to another
storage account where I need the access
keys and I can do that can you think of
pause for a moment can you think of a
reason you would ever you
this well yeah one is to move files and
we lecture that's very simple we are
moving files one of the other things
that you can do well think about it
what are other things do we store here
PhDs right
so imagine a client came to you and said
hey I have this old subscription where
when azure came out three four years ago
I created all this virtual machines I do
not know what we did all things are
messed up we want to start brand new
what can we do well create another
subscription create a storage account
you know you are going to architect this
differently and properly but you
probably do not have to recreate the
virtual machines all you can do is go to
that subscription take it to storage
a key for the primary storage and what
the VHD is located and use the easy copy
to go to a totally different storage
account to a totally different
subscription and just move the VHD file
so all of a sudden you have this new
subscription with a new storage account
with all the new VHD files and if you
look at my previous sessions I'll show
you how to take a VHD file create a disk
and create a new virtual machine we do
this all the time and this is real-life
stuff guys I mean you will be doing that
for a lot of clients even for your
company most likely you know somebody
probably play around by the virtual
machine but now that you do is you're
more after you watch my videos you're
like eh let me read architect this but I
don't want to create new virtual
machines because things are already
created for me but then how can I take
this and move from one storage again to
the other
the reason this actually works by the
way because you can see over here my
these two storage accounts we're in the
same subscription right I'm using the
same subscription this could be
completely two separate subscriptions by
the way the only reason this actually
works because you have access to two
things one is the URI which is the URL
for your storage the container and the
other one is the key without this key
you could not have done that once you
have the key doesn't matter if the
storage account is in the subscription
other subscriptions one located in Asia
one in USA West or Central USA it does
not matter it will do the whole thing
for you so this is a pretty cool tool
is that copy to actually do this can you
do this with PowerShell absolutely but
is is a copy easier absolutely as well
okay so this is a really good tool to do
that and we use this all the time
cool so let's go back to the slides so I
will showing you the cool way of using
is a copy to copy files from your local
computer move from one storage account
to another
you can probably try it out with
different subscriptions or different
things in your organization as well okay
there is that forward slash question
mark you can put on the console over
there after you have downloaded laser
copy it shows you all the other commands
that you can do now the other tool it's
called Microsoft Azure storage Explorer
it happens to be one of my favorite ones
over here you can download it from
storage Explorer comm is by Microsoft
it's another tool that's really really
cool to actually do storage stuff in so
I already have that downloaded and stuff
so Microsoft Azure storage copy let's go
do this it will open up a little tool
and what you've got to do is basically
connect to your account so let's go
ahead and connect so I create the little
gear box here let's add an account right
so you're going to put your account here
I'm going to put mine personal account
put in the password so basically it's
making a connection to my subscription
once it does that it loads the
subscription that's my subscription
let's apply that it just look at this
it's a Windows tool it went and brought
up my brought up my storage accounts
really neatly see you blob container as
you can see you can upload and download
and do plenty of things over here very
cool and seamless way obviously my free
HD is here so it's a tool if you are
using your Azure storage to upload and
download stuff from your organization
your computer other storage is stuff
files 3 HD is even you can do it from
here
can you tell me what you can do with
this tool something really really cool
well think about it
you know this whole hybrid cloud thing
whether you have your own premises and
you have your cloud thing let's say
somebody gave you a task and said hey go
and take our diversion machines that we
have here do a POC a proof of concept
that this actually works in Azure cloud
you can take the VHDs that you have in
your organization you can upload it to
your as your account so all of a sudden
your storage again now has a VHD watch
on up one of my sessions from before how
to take a VHD created disk and create a
virtual machine that's called migrating
your on-premise virtual machines to your
Azure cloud how cool is that as simple
as this can you do this with PowerShell
absolutely using this tool makes it more
simpler I love going if I can do
PowerShell automation great if I'm doing
a task many many times but if I can use
a great to do something that I'm going
to do this one-off time great this total
is amazing to do that and I'm hoping
that you're getting some value of this
session today because these are the
stuff you probably want to do in your
organization right all of a sudden you
have this hybrid expert who can take all
the virtual machines from your
on-premise set put it in the cloud show
your organization how this can be done
in the cloud as well and maybe move some
of the virtual machines over there right
pretty cool so Microsoft
Explorer this is another cool tool so we
have not talked about queues and tables
it can also do queues in table it's a
very nice GUI Microsoft File Explorer
way of viewing your blobs cool I think
this is pretty neat too now the last one
is Microsoft Visual Studio so if you're
a developer this is pretty important for
you if you're not even a developer you
just do stuff in or like using another
tool to do this you can use Microsoft
Visual Studio as well I'm going to show
you real quick how to do that looks at
kind of looks a lot like this actually
to be honest
let's do visual Institute of 2015 let's
load this up alrighty it's loaded I'm
going to go to view here and in view I'm
going to go to server Explorer let's try
that here let's load that go to my
storage it's refreshing
the reason this visual studio actually
picked up my subscription already
because I was logged in so as you can
see I actually went and logged in over
here if you're not logged into your
subscription it will actually ask you to
connect to your subscription I've
already done that
so it already showed up here looks a lot
like let's lock like this right looks a
lot like that as your stories Explorer
that's how they might have figured this
whole thing out the HD is you blob
retainer yeah pretty much looks a lot
like as your storage Explorer
let's just close that but I just want to
show you that you have another way to
access the exit the storage account from
here ok let's go let's wrap this up it's
been a while so let's finish this with
the conversation that we looked into the
blob storage and looked into some
security stuff of your storage account
using the primary key and the secondary
key I was very excited like creating
this session because I felt that this is
something you're going to do every day
as a cloud infrastructure admin or a
cloud you know
expert so you are going to use blob
storage which is very important because
not only this is files but this is also
the VHD files that you can put over here
okay
we looked into how to create containers
in this session which is basically
nothing but a folder you have different
ACL or different access policies that
you can put in there and you know when
you create a VHD the container is going
to be private or the default one is
going to be private access policy but
everything else you can actually put it
as public so other people can use the
URL to access your blob okay there might
be a lot to observe in this session so
feel free to you know pause and try this
out that's my whole thing that you
should pause these videos and try this
out and follow it so you get that
hands-on experience I do not
demo anything over here in fact I skip
some of the stuff if I can't demo it
over here and I just mentioned that
because I want you to get the complete
value out of this sessions okay and I
showed you different tools how to use as
your storage besides the portable and
partial because in real life yeah great
you might have partial scripts to do a
lot of things but some of these tools
will make things so much simpler for you
if you don't want to get it complete
like you you want you don't want to get
this complicated right and I use
PowerShell a lot to actually do that is
a copy stuff because there are other
things I can do there I might have like
ten VHDs that the PowerShell is going to
use different timer options to actually
upload them when it's not the busiest
time of the day so yeah you can use
partial to do this but if you're doing
this one off or doing a little demo or
little proof of concept you can actually
do this using those tools and those
tools I use quite a bit if you're going
to move from one storage account to
another one to migrate virtual machines
as well as to make the high priority
stuff from your on-premise to your the
cloud stuff in Azure okay so I hope this
is giving you a lot of value and you are
excited with the session to do a lot
more things in the upcoming session so
I'm going to start working more on the
table queue and the file I'll show you
more interesting things that you can do
with Azure storage account but for now I
think this is pretty cool
try it out let me know in the comment
section you know like what worked for
you different
we you are using this create a
conversation if you can okay and of
course like the video if you if you
think it's a pretty good valuable video
for you okay
so as usual my training site is that
table ranger net forward slash as your
training you're most likely to be
viewing this on youtube at cloud range
of network slides slides slides I keep
telling you guys I'm sorry I did not
have this before but now I have it my
slides are at slideshare.net shan is
well so I'm going to upload all my
slides there it's already there actually
every time I upload a video I go put my
slides there download the slides and get
it from there people email me asking me
for the scripts well some of the scripts
it's a long one I go and put it put it
in my cloud Ranger net blog if it's not
a big one like the ones we use today you
can just take it off my slides go
download the slide it'll be right there
or pause the video if you're going to
try this out yourself which I hope you
are you can just pause the video and
just type it all out on your PowerShell
and get the scripts that way a lot of
people email me hey can you send me the
script for that you know what frankly I
try to give them whenever I can but I'm
like why are people not taking this off
the videos or are people not really
trying this out themselves you should be
saving the scripts or this commandlets
somewhere in a little notepad for
yourself for your training because first
of all one it's going to be extremely
helpful for your exam and two it's all
real life scenarios right I mean you
need to go and save this so you can do
work in your organization or in your lab
and everything as things come along
right there's more and more complicated
things that will come along more
complicated environments that you create
where you need to use this more often
for me this is simple one demo it's done
but I have this master list where I'll
keep all these commandlets for use okay
so get them from my slides my twitter is
at Shawn as well where I twit when new
videos come up or anything else my email
is shown at cloud range of net not very
responsive lately there's a lot to do so
I'm a little behind on my email feel
free to connect me on LinkedIn if you
wish to you know get into more
conversations or just be connected and
see what I can do anyways thank you for
viewing please like the video
on YouTube and I will see you in the
next session right