Skip to content

Add larger memory flavors #938

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Add larger memory flavors #938

wants to merge 2 commits into from

Conversation

scoopex
Copy link
Contributor

@scoopex scoopex commented May 25, 2025

The openstack flavor manager fetches the flavor definitions from the conformance test.
These definitions contain a "mandatory" and a "recommended" section.

I think it would be a good idea to have a set of default flavors in this file with the larger amounts of memory described, because in my opinion there is a high probability that something like this will be used very often (e.g. for database page caches). On the other hand, I don't think that variations of larger numbers of CPUs (apart from the existing ones) are needed very, because huge cpu workloads are often better distributed by multiple virtual machines (i.e. by using kubernetes).

I therefore advocate that we make flavors with larger amounts of RAM available in the recommended section of that file, as otherwise there will be more variants or SCS users will have to contact their provider every time.

From my point of view, it is very useful for SCS users if they can also expect larger flavors from different suppliers.

@scoopex scoopex force-pushed the add_larger_flavors branch from 102b0a9 to 1647fa7 Compare May 25, 2025 16:31
@scoopex scoopex marked this pull request as draft May 25, 2025 16:35
@scoopex scoopex self-assigned this May 25, 2025
@scoopex scoopex requested a review from mbuechse May 25, 2025 16:36
@scoopex scoopex marked this pull request as ready for review May 25, 2025 16:37
@fkr
Copy link
Member

fkr commented May 26, 2025

As discussed on Matrix (https://matrix.to/#/!xlFjWCAoQenuOeIVQw:matrix.org/$2bVMQjnP0QpGkOVtlVSusyt4gTQfaoGybYPkBUn2u2M?via=matrix.org&via=regio.chat&via=matrix.uhurutec.com) and suggested by @mbuechse: this is a good candidate to being discussed in the next Lean Coffee. The next Lean SCS Operator Coffee is on June 12.

@depressiveRobot
Copy link
Contributor

As discussed in the Lean SCS Operator Coffee on June 12, a survey of the SCS members and market analysis may be a good way to find out which additional (larger) default flavors are needed.

@garloff recommended to add the new flavors as recommended first and make them mandatory later to give providers time to adapt.

Signed-off-by: Marc Schöchlin <[email protected]>
@mbuechse mbuechse force-pushed the add_larger_flavors branch from 68ff3c9 to 93d61aa Compare June 25, 2025 11:08
@mbuechse mbuechse marked this pull request as draft June 25, 2025 11:09
@mbuechse
Copy link
Contributor

Converted this to draft because this is mainly a point for organizing the discussion. If the larger flavors are to be added, then the file(s) to be changed would be a little different.

@scoopex scoopex marked this pull request as ready for review June 26, 2025 06:35
@scoopex scoopex marked this pull request as draft June 26, 2025 06:36
@horazont
Copy link
Member

horazont commented Jun 30, 2025

Hello there.

I ran some statistics:

COUNT   RAM     VCPUS  RATIO
    144 4096    2      2:1
    109 1024    1      1:1
     64 8192    4      2:1
     52 65536   16     4:1
     40 2048    1      2:1
     39 16384   8      2:1
     38 32768   8      4:1
     31 16384   4      4:1
     28 4096    1      4:1
     27 32768   16     2:1
     22 8192    2      4:1
     16 512     1      0.5:1

This is our current use in the currently most relevant one of our public cloud sites. Grouped by ratio:

COUNT    RATIO
    314  2:1
    171  4:1
    109  1:1
     16  0.5:1

Not sure if I can make it to this week's standardisation SIG, but there we go.

All these flavors are dedicated thread (not dedicated core and not shared core).

Needless to say, this cloud is not SCS compliant, also because of the flavors. And obviously, this is biased, as our customers can only use what we offer. Hence, there cannot be any usage of >=8:1 flavors or of flavors with more than 64 GiB of RAM in this particular site.

(We are working on renewing the public cloud offering and are of course looking into the general direction of SCS flavors for inspiration of how we build it.)

@scoopex scoopex changed the title add larger memory flavors Add larger memory flavors Jun 30, 2025
@depressiveRobot
Copy link
Contributor

depressiveRobot commented Jul 11, 2025

Further discussion in SIG Std/Cert meeting on 2025-07-10 with the following suggestion:

  • add larger memory flavors as "recommended" with 64 and 128 GiB of RAM for CPU/RAM ratios 1:2, 1:4, 1:8
  • brief explanation what "recommended" means

What would be the best place to add a brief explanation of what we mean by “recommended”?

@berendt
Copy link
Contributor

berendt commented Jul 11, 2025

If you want to offer flavors only for specific memory sizes (e.g. 32 GB), you should include all recommended flavors for this specific memory size.

"Recommended" does not mean that you should use all available flavors from the entire list. Instead, the recommendation only refers to the flavors for your desired configuration (e.g. 32 GB).

Example: If you want to offer 32 GB instances, only include the flavors recommended for 32 GB - not all flavors from 2 GB to 128 GB that might be available in total.

@depressiveRobot
Copy link
Contributor

If you want to offer flavors only for specific memory sizes (e.g. 32 GB), you should include all recommended flavors for this specific memory size.

"Recommended" does not mean that you should use all available flavors from the entire list. Instead, the recommendation only refers to the flavors for your desired configuration (e.g. 32 GB).

Example: If you want to offer 32 GB instances, only include the flavors recommended for 32 GB - not all flavors from 2 GB to 128 GB that might be available in total.

Thank you for the short and precise explanation.

Another thing which popped into my head: Are SCS-32V-64, SCS-32V-128 and SCS-64V-128 even desired flavors?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants