EC2 AMI version

[beng]

Hi,

Using the Amazon EC2 AMI I'm getting the following error, that I'm not getting when i run on windows...

Want: uniaxialMaterial Hysteretic tag? mom1p? rot1p? mom2p? rot2p? <mom3p? rot3p?> mom1n? rot1n? mom2n? rot2n? <mom3n? rot3n?> pinchX? pinchY? damfc1? damfc2? <beta?>

I see from other posts that new versions fix this issue, but the EC2 AMI seems to be on 2.4.6 (6022) - is there an updated version? or how could i update the AMI myself?

Many Thanks in advance!

Ben

[fmk]

i am in the process of making one for the new release .. you can of course make your own by starting with some blank linux ami, installing and building OpenSees and then creating an image of what you have.

[beng]

Ok thanks very much for the speedy reply, I'll wait for your new release. No doubt it will be better as i am by no means an expert.

Ben

[fmk]

you are running the command from a dos prompt and starcluster is on your PATH

[fmk]

thanks .. i might need to upgrade to windows10 as i hate dos

[fmk]

thanks for the info .. i have updated the opensees amazon page ..

[kengawk]

dear @Cagatay

Setuptool seems not work after clickiing on ez_setup.py and poping up a black window of python in firefox.
downloading setuptools-26.0.0.zip...

Command prompt cannot recogize the command of pip install StarCluster.
Could you give me some advice?
Thanks a lot!

[kengawk]

C:\Users\Administrator.USER-20160705YO>starcluster start smallcluster

Traceback (most recent call last):
File "D:\Python27\Scripts\starcluster-script.py", line 5, in <module>
from pkg_resources import load_entry_point
File "D:\Python27\lib\site-packages\pkg_resources.py", line 2603, in <mod
working_set.require(__requires__)
File "D:\Python27\lib\site-packages\pkg_resources.py", line 666, in requi
needed = self.resolve(parse_requirements(requirements))
File "D:\Python27\lib\site-packages\pkg_resources.py", line 565, in resol
raise DistributionNotFound(req) # XXX put more info here
pkg_resources.DistributionNotFound: optcomplete>=1.2-devel

C:\Users\Administrator.USER-20160705YO>

[kengawk]

Dear @cgtydmrc

Thanks for your sharing your resource for instruction.
I install them again in window 7 system.

I type "C:\Python27\Scripts>pip install StarCluster" in dos prompt.
Error message shows that C:\Python27\Scripts\pip.exe is not compatible with the version of windows system.

And I find the problem may be located in setuptool that value error: Entry point must be listed in groupstayou could take a look in google drive linked below.
https://drive.google.com/file/d/0B2M0Ty ... sp=sharing

cgtydmrc wrote:
> Dear Kai,
>
> When you would like to install setuptools, please use mozilla firefox. When
> you click on ez_setup.py, it will directly be installed.
>
> You will install StarCluster by running CMD in this directory
> C:\Python27\Scripts.
>
> You can find detailed information here..
> https://drive.google.com/drive/folders/ ... mNvekVENHc

[kengawk]

Thanks for your help!
Try it as your suggestion goes.

And now I think I found the problem is that the setuptool can not be installed successfullly.
The following is error when I am installing setuptool.
value error comes up.It warns that Entry points must be listed in groups.

https://drive.google.com/file/d/0B2M0Ty ... sp=sharing
Extracting in c:\users\admini~1.use\appdata\local\temp\tmpteovsq
Now working in c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.
0.0
Installing Setuptools
Traceback (most recent call last):
File "setup.py", line 194, in <module>
dist = setuptools.setup(**setup_params)
File "C:\Python27\lib\distutils\core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\set
uptools\dist.py", line 349, in __init__
for ep in pkg_resources.iter_entry_points('distutils.setup_keywords'):
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 730, in iter_entry_points
entries = dist.get_entry_map(group)
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 2629, in get_entry_map
self._get_metadata('entry_points.txt'), self
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 2363, in parse_map
raise ValueError("Entry points must be listed in groups")
ValueError: Entry points must be listed in groups
Something went wrong during the installation.
See the error message above.


And I installed VS2012.

Thanks again! I really appreciate it.

cgtydmrc wrote:
> You shoud open command prompt in this directory
> "C:\Python27\Scripts" by shift button and right click. Then you
> should type "pip install StarCluster".
>
>
> ***You may also need to install Visual Studio if you confront any problems
> when installing StarCluster.*** This is very important.
>
> Hope this helps.

[kengawk]

Dear Cagatay,

Now I found that it's proper for me to make 32bit python installation so that I could install starcluster successfully

according to the instruction that you shared with me.

What is the most important info in the config file? I really feel a little bit confused.
Now I changed the segments in config file as below:
1AWS_ACCESS_KEY_ID = #your_aws_access_key_id
2AWS_SECRET_ACCESS_KEY = #your_secret_access_key
3AWS_USER_ID= #your userid
4[key mykey]
5KEY_LOCATION=~/.ssh/mykey.rsa
6KEYNAME = mykey

How can I revise the keypair? I creat key according to the contents from 'starcluster createkey -help'

G:\peer\AmazonEC2>starcluster createkey -i pk-APKAICAVVT6INVOFHD4Q.pem -o myfirs
t.rsa myfirst
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Successfully created keypair: myfirst
>>> fingerprint: 98:3a:ea:f0:60:65:80:be:aa:1b:61:32:52:1f:a0:85


and it seems to create a rsa file from keypair file with a keyname,but where's the rsa file? I can't find it in my computer.
How can I revise the config file and create key file correctly?

G:\peer\AmazonEC2>starcluster start smallcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
!!! ERROR - Cluster settings are not valid:
!!! ERROR - key_location
!!! ERROR - 'C:\Users\Administrator.USER-20160705YO/.ssh/myfirst.rsa'
!!! ERROR - does not exist

Cheers,

Kai

@cgtydmrc
cgtydmrc wrote:
> You shoud open command prompt in this directory
> "C:\Python27\Scripts" by shift button and right click. Then you
> should type "pip install StarCluster".
>
>
> ***You may also need to install Visual Studio if you confront any problems
> when installing StarCluster.*** This is very important.
>
> Hope this helps.

[kengawk]

Thank you,Cagatay!!
It is really a great help for me!

Now I met a problem once more according to that demo video, could you give me some tips?

I cannot start the cluster,the error messages is as the following.
C:\Users\Administrator.USER-20160705YO>starcluster start myfirstcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

Thanks again.
I solved that problem.
1 starcluster createkey mykey -o ~/.ssh/mykey.rsa
2Revised the keypair name mykey to agree with the name from starcluster!
[key mykey]
KEY_LOCATION=C:/Users/Administrator.USER-20160705YO/.ssh/mykey.rsa
[cluster smallcluster]
# change this to the name of one of the keypair sections defined above
KEYNAME = mykey



C:\Users\Administrator.USER-20160705YO>starcluster start myfirstcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
>>> Cluster template settings are valid
>>> Starting cluster...
>>> Launching a 2-node cluster...
>>> Creating security group @sc-myfirstcluster...
Reservation:r-0b21043af727c806b
>>> Waiting for instances to propagate...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for cluster to come up... (updating every 30s)
>>> Waiting for all nodes to be in a 'running' state...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for SSH to come up on all nodes...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for cluster to come up took 2.542 mins
>>> The master node is ec2-54-163-55-141.compute-1.amazonaws.com
>>> Configuring cluster...
>>> Running plugin starcluster.clustersetup.DefaultClusterSetup
>>> Configuring hostnames...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Creating cluster user: sgeadmin (uid: 1001, gid: 1001)
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Configuring scratch space for user(s): sgeadmin
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Configuring /etc/hosts on each node
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Starting NFS server on master
>>> Configuring NFS exports path(s):
/home
>>> Mounting all NFS export path(s) on 1 worker node(s)
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Setting up NFS took 0.439 mins
>>> Configuring passwordless ssh for root
>>> Configuring passwordless ssh for sgeadmin
>>> Running plugin starcluster.plugins.sge.SGEPlugin
>>> Configuring SGE...
>>> Configuring NFS exports path(s):
/opt/sge6
>>> Mounting all NFS export path(s) on 1 worker node(s)
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Setting up NFS took 0.271 mins
>>> Installing Sun Grid Engine...
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Creating SGE parallel environment 'orte'
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Adding parallel environment 'orte' to queue 'all.q'
>>> Configuring cluster took 3.287 mins
>>> Starting cluster took 5.919 mins

The cluster is now ready to use. To login to the master node
as root, run:

$ starcluster sshmaster myfirstcluster

If you're having issues with the cluster you can reboot the
instances and completely reconfigure the cluster from
scratch using:

$ starcluster restart myfirstcluster

When you're finished using the cluster and wish to terminate
it and stop paying for service:

$ starcluster terminate myfirstcluster

Alternatively, if the cluster uses EBS instances, you can
use the 'stop' command to shutdown all nodes and put them
into a 'stopped' state preserving the EBS volumes backing
the nodes:

$ starcluster stop myfirstcluster

WARNING: Any data stored in ephemeral storage (usually /mnt)
will be lost!

You can activate a 'stopped' cluster by passing the -x
option to the 'start' command:

$ starcluster start -x myfirstcluster

This will start all 'stopped' nodes and reconfigure the
cluster.







>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
!!! ERROR - Cluster settings are not valid:
!!! ERROR - Keypair 'mykeypairname' doe-------------s not exist in region 'us-east-1'

@cgtydmrc wrote:
> You can also watch the video in the following link which helps you how to
> modify your own config file. http://star.mit.edu/cluster/index.html

[egzonk]

cgtydmrc wrote:
> You can also watch the video in the following link which helps you how to
> modify your own config file. http://star.mit.edu/cluster/index.html

Thank you very mutch sir , it rreally helped me.

[vickytaneja]

Your Content is as decent as you seem to be.

A debt of gratitude is in order for sharing such profitable data.

Kindly see this - https://malwarebrains.blogspot.com/2019 ... ivers.html

[jk7070]

Hi,

Can the AmazonEC2 cluster be used with opensees files written in python (.py) rather the .tcl? I have models built using opensees.py and it would be nice if we could run these without having to rewrite in .tcl.

If it is currently not supported, is it likely it will be supported in the future and if so how far away is this likely to be?

Regards