Tag Archives: Sync

How to Sync Files and Folders with Amazon S3 Bucket

CloudBerry Explorer for Amazon S3 comes with an ability to synchronize the content of your local folder with Amazon S3 bucket. In other words you can configure make sure the files on your local computer are identical to those in your Amazon S3 storage account. This might be helpful when you want to upload the most recent copies of your local files to S3.
Continue reading

We Introduce CloudBerry Box 1.2 with Custom Sync Folder

As always we are adding features that our customers are requesting. CloudBerry Lab presents a new version of CloudBerry Box 1.2. Now CloudBerry Box allows to set a custom sync folder that you want to use for synchronization.

Continue reading

CloudBerry S3 Explorer: Compare and Sync Enhancements

As always we are adding features that our customers are requesting. in the release 2.7.6 we are adding quite a few usability improvements to our synchronization feature. the most notable improvements include custom filters for sync, CloudFront Invalidation option, correct ETag for multipart upload and PowerShell enhancements

What's new

1.      An exclusion list for synchronization ( for example exclude ".svn/*").

2.      Option to Invalidate CloudFront content on sync.

3.      When Multipart upload is used, the ETag is formed correctly

4.      The sync folder configuration is now included into export / import settings

5.      Ability to sync files using the target bucket storage class

6.      PowerShell: An option to set the storage class to Reduced Redundancy Storage (RRS) when synchronizing files

7.      PowerShell: Ignore "access denied" folders in Copy-CloudSyncFolders

8.      An option to release the license on uninstall

+++

Note: this post applies to CloudBerry Explorer 2.7.5 and later.

As always we would be happy to hear your feedback and you are welcome to post a comment.

CloudBerry S3 Explorer is a Windows freeware product that helps managing Amazon S3 storage and CloudFront.

Related products:

Developed Amazon S3 Synchronization Feature

Note: this post applies to CloudBerry Explorer 2.0 and later.

In this blog post we will demonstrate an optimization that we added to our "Sync Folders" feature that allows to sync Amazon S3 bucket with local folders. In the previous version of CloudBerry S3 Explorer we do request header for each file on s3 to get original date modified. It used to make the user pay extra money to Amazon because of the number of requests (equals to number of files on s3).If you let’s say have 70 000 files on S3 that you want to sync, every time sync feature runs it would run a head request 70 000 times.

In the version 2.0 we are adding an option "Compare Content", which is ON by default. Continue reading

Sync Folders – Delete Files With CloudBerry S3 Explorer

As always we are adding features that our customers are requesting. Ever since we first introduced "Sync Folders" feature allowing to sync Amazon S3 bucket with local files and folders, users have been telling us that they would want to be able to make sure that the contents of Amazon S3 buckets are identical to local folders.In other words if a file is deleted locally it should be deleted from Amazon S3 too. We were reluctant to implementing this feature because if the file is deleted there is no way to recover it. However, our users insisted that they will use the feature carefully and take all the responsibility. Moreover with the advent of Amazon S3 versioning, it became little easier to recover deleted files, provided that the versioning is on for a bucket.

With the release 1.9 we added an option to delete files on target.If this option is on when you deleted the file on the source (your local computer) it will be automatically deleted from the target (Amazon S3). This option is off by default and we hope you will be using it carefully.

image001

CloudBerry Explorer is becoming a comprehensive tool for Amazon s3 management, with the newer release not only can you synchronize folders with more flexible options, but also you are getting the advanced compare tool.

Note: this post applies to CloudBerry Explorer PRO 1.9 and later.

CloudBerry S3 Explorer is a Windows product that helps managing Amazon S3 storage and CloudFront.
Related products:
Like our products? Please help us spread the word about them. Learn here how to do it.

How to Compare Contents of Amazon S3 and Local Disk with CloudBerry S3 Explorer

As always we are adding features that our customers are requesting. This time we decided to add a feature that allows comparing contents of Amazon S3 storage with the folders on your local computer. As of version 1.6 we are offering an option to synchronize local folders with Amazon S3. While offering this feature we learned that our customers want more flexibility and visibility when it comes to comparing the folders before the synchronization.

image001

There are a number of options available in the compare tool on the toolbar and each option worth a small description.

image003

Sync Direction options allows you to select if you want to sync from left to right panel, from right to left or bi-directional sync.

image005

Missing Only will highlight only files that do not exist on target in this case only the files missing on the target will get copied.

Delete on Target - will delete file on target if it doesn’t exist on the source anymore.

image007

Include subfolders will compare all the contents of all the subfolders beneath current folder.

Save - will save settings in the existing sync folder or ask to create a new sync folder.

image009

Filter allows you to select what files to you want to see in the list.

image011

If you click Compare it will basically compare the contents again taking into account the filter you set.

Sync Now will create a Sync Folder

Conclusion

Overall, CloudBerry Explorer PRO becomes more and more comprehensive tool for those who work with Amazon S3 storage on a professional level. We hope you will find the enhancement useful and we are looking forward to your feedback.
Note: this post applies to CloudBerry Explorer PRO 1.9 and later.

CloudBerry S3 Explorer is a Windows product that helps managing Amazon S3 storage and CloudFront.

Related products:

How to Synchronize Local Folders With Amazon S3 Using CloudBerry S3 Explorer pro and PowerShell

Note: this post applies to CloudBerry Explorer 1.6.3 PRO and later.

We continue enhancing PowerShell command line interface for Amazon S3 in CloudBerry Explorer and recently we added a command that complement the new Sync Folder feature. Check out our post about syncing AmazonS3 bucket with local folders if you want to learn more about that feature.

In this post we will explain how you can configure automated synchronization using the new PowerShell command.Here is an example

First you have to configure proxy settings

Set-CloudOption -ProxyAddress {PROXY} -ProxyPort 8080

Then you have to connect to your Amazon S3 account with access key and security key

$s3 = Get-CloudS3Connection -Key XXXX -Secret XXXX

Select the path on Amazon S3

$source = $s3 | Select-CloudFolder -Path boooks/sync

Connect to local file system and select local folder

$local = Get-CloudFileSystemConnection

$temp = $local | Select-CloudFolder C:\tempsync

Synchronize contents from $source to $temp, in other words from Amazon S3 to local folder

$source | Copy-CloudSyncFolders $temp

Or synchronize content in both ways.

$source | Copy-CloudSyncFolders $temp –Bidirectional

You can save the whole script into the files and schedule it using Windows Task Schedule to run synchronization periodically.

If you came to this post by chance you should know that CloudBerry S3 Explorer PRO is a Windows program that helps managing Amazon S3 storage and CloudFront.

Like our products? Please help us spread the word about them. Learn here how to do it.

 

What’s New in CloudBerry S3 Explorer Sync Folders

A few weeks ago we released a preview of Sync Folders feature that allows automatically synchronize local folders with Amazon S3 buckets. Over a few weeks we got we gathered some feedback from our user community and we are happy to announce some improvements.

Sync folders based on names only

This option works exactly like its name implies. In other words it will only copy files if it finds the files with new names. This option works faster as we don’t have to identify date modified for each files.

image001

Sync folder apply ACL automatically

In the previous release you had to manually set ACLs to the files copied to the bucket using Sync Folder features. In the latest release the bucket ACL can be applied to new files automatically. To make it work you have to set Permission inheritance option in Tools | Options | Copy/Move tab:

image003

A bit of usability…

And last but not least some of our users complained that they were confused once they created a sync folder. What should I do next? Does it run automatically or I should do something to run it? We added a message explaining what you should do next to run sync.

image005

Note: this post applies to CloudBerry Explorer 1.6.5 and later.

CloudBerry S3 Explorer is a Windows product that helps managing Amazon S3 storage and CloudFront.
Related products:
Like our products? Please help us spread the word about them. Learn here how to do it.