FC Pools on a Managed Array (COMSTAR)
Use this page when Karios should create and manage the disks on your Fibre Channel SAN array. Karios logs in to the array, carves one volume for every VM disk, and shows it to the host that runs the VM.
If you want to attach LUNs that already exist on your own FC array, use Generic FC Pools (Existing LUNs) instead. For shared concepts (ports, paths, readiness, health), see Fibre Channel Storage.
UI path: Control Center -> Storage -> Instance Storage
When to Use
You have a COMSTAR array (illumos or a compatible ZFS appliance) with FC target ports on the fabric.
You want VM root disks, data disks, and templates to live on that array.
You want Karios to create, grow, and remove the array volumes for you.
What Karios Does on the Array
Once a pool is in use, Karios manages these objects on the array:
One FC target group named
karios-fc. The array ports you set up join it.One host group per Karios host, named
kh-<host name>. Each host is admitted by its own initiator WWPN.For each VM disk: one ZFS volume under the dataset you name, one logical unit, and one view that shows it to the host group of the host running the VM.
Karios does not change the switch. Zoning stays yours.
Before You Start
[ ] You are a platform administrator. Only a platform administrator can register an array or set up one of its ports. Creating a pool on a registered array needs the storage manage permission.
[ ] The array’s STMF service is online and its FC ports run in target mode.
[ ] The ZFS pool that will hold the volumes exists, for example
sanpool. Pick a dataset path under it, for examplesanpool/karios. The dataset itself can be new.[ ] You have a management address, a username, and a password for an SSH account that can run the array’s COMSTAR and ZFS commands, and the array’s SSH host key from
ssh-keyscan -t ecdsa <management address>.[ ] Use array ports that are dedicated to Karios. A port must join
karios-fc, and joining takes the port offline for a moment. Karios refuses to join a port that something outside Karios is logged in to.[ ] The fabric meets the checklist in Fibre Channel Storage: every host in scope has an HBA and is zoned to the array’s ports.
Important
FC has no CHAP. Hosts are admitted by per-host WWPN masking on the array and by the switch’s zoning. Keep the fabric dedicated to storage.
Task 1: Register the Array
When to Use: Do this once per array, before you create the first pool on it.
Purpose: Store the array’s address, credentials, and host key so Karios can manage it.
Steps:
Open
Control Center -> Storage -> Instance Storage.Click
Add Instance Storage. TheAdd New Instance Storagepanel opens.Set
Protocoltofc. InDriver, pickcomstar (carves volumes on an array). Only drivers that carve volumes and support FC are offered here.If no array is registered yet, the
Register arrayform is already open. Otherwise, clickRegister arraynext toArray.Fill in
Array name,Driver(comstar),Dataset,Management address,Username,Password, and theArray SSH host key. The fields are the same as for an iSCSI array; see iSCSI Pools on a Managed Array.Click
Register. Karios probes the array before it stores it.
Expected Outcome:
The array appears in the
Arraylist and is selected.The panel shows
SSH host key verified:and the key.The
Array FC portscard fills with the array’s target ports.
If this fails:
KF-5010: the array did not answer. Check the management address, the network path from the management node, and the credentials.KF-5011: the array answered but the probe failed. Check the credentials, that the array runs COMSTAR with STMF online, and that the ZFS pool named inDatasetexists.The array lists no FC target port: its HBA ports are not in target mode. Fix that on the array, then click
Re-check.
Task 2: Set Up the Array Ports
When to Use: Do this once per array port, before the first pool on the array.
Purpose:
Add each port to the karios-fc target group so it serves this array’s LUNs.
Steps:
In
Add New Instance Storage, with the array selected, read theArray FC portscard. Each row shows the port’s WWPN and aStatus:Serving: online and already in the target group.Needs setup: online but not in the target group yet.In use elsewhere: online but something outside Karios is logged in to it.Offline: link down. Check the cable, SFP, and switch port.
Click
Set upon eachNeeds setupport you want Karios to use. Read the confirmation: the port goes offline for a moment while it is added. If the array could not count the sessions on the port, the dialog says so; check on the array first.Click
Set upin the dialog.
Expected Outcome:
The port reads
Serving.On the
Hostscard, hosts zoned to that port now readReadyand count it.
If this fails:
The port was not set up: the array refused the join, usually because the port carries sessions from outside Karios. Move them off the port or pick another port.Admin only: you are not a platform administrator. Ask one to set up the port.
Task 3: Create the Pool
When to Use: Do this after the array is registered and at least one port is serving.
Purpose: Create an FC pool that places VM disks on the array.
Steps:
In
Add New Instance Storage, setScope:Zone: every cluster in the zone can use the pool.Cluster: one cluster only. Pick thePodandCluster.
Pick the
Zoneand enter aNamefor the pool.Set
Protocoltofc,Drivertocomstar, and pick the registered array.Under
Ports to watch for health, leave every serving port ticked, or untick the ports this pool’s health should not count. At least one stays ticked. The pool is served through every port the array has set up either way.Read the
Hostscard. Every host in scope should readReadyand name the ports it sees. For a host that readsNot zoned, clickShow zoning commands, enter the active zoneset and VSAN, and paste the commands on the switch. Then clickRe-check. For a host that readsUnknown, wait for its report, or restart the Karios host service on it.Create stays off while no host in scope reaches the array.Check
Minimum paths. Karios proposes the value from what the hosts see, capped at the ticked ports. If it reads1and a host has measured one path, tick the single path acknowledgement.Optional: add
Storage tagsto steer disks of certain volume profiles to this pool.Click
Add Instance Storage.
Expected Outcome:
The pool appears in the list with protocol
FC COMSTAR.On the pool’s detail page, the
Fabriccard showsHealthasUponce every host in scope has reported. With some hosts not zoned yet it readsDegradedand names them.
If this fails:
KF-4013: a host sees fewer paths thanMinimum paths. The message names the host, its WWPN, and how many of the pool’s ports it is logged in on. Zone the host to the missing port, bring the port back, or lowerMinimum paths.The create is refused because no host in scope reaches the array: zone at least one host, or pick a scope that holds a zoned host.
Set up at least one port before creating the pool.: go back to Task 2.The button goes off after you fill the form: a host in scope has not reported yet, so the form has nothing to count. Restart the Karios host service on that host, click
Re-check, and try again.
Fabric Card Reference
Open the pool from the list to see its Fabric card.
Row |
What it shows |
|---|---|
|
Pool health from the hosts. See Fibre Channel Storage. |
|
Whether the platform has accepted the pool. |
|
The registered array and the dataset volumes are carved under. |
|
|
|
The pool’s path floor. A |
|
The array ports health is measured against, with |
|
The pool’s admin state, for example |
|
Each host’s reachability: how many of the pool’s ports it sees, when it last reported, and any disk on it that is not healthy. |
|
The most recent error, if any. |
Task 4: Work With Disks on the Pool
When to Use: Use this when you create, grow, or remove VM disks that land on the pool.
Purpose: Know what Karios does on the array for each disk action.
Steps:
Create VMs and disks as usual. See Block Storage. Disks land on the pool when its scope and storage tags match the volume profile.
When a disk is first attached to a VM, Karios creates its volume on the array and shows it to that VM’s host. The host finds the new LUN on its HBAs and builds one multipath device for it. Each detach removes the view again.
To grow a disk, use
Update Disk Sizein Block Storage. Karios grows the volume on the array, the host re-reads the paths, and a running VM sees the new size. Disks can only grow.When you deploy VMs from a template, Karios keeps one copy of the template on the pool and clones each root disk from it on the array.
Expected Outcome:
On the pool’s
Fabriccard, theHostsrows name no disk as unhealthy.In Block Storage, the
Fabric pathspanel readsHealthyfor a disk held by the node that answers the request, with one path per array port.
If this fails:
KF-4013on attach: the host sees fewer of the pool’s ports than the minimum. Check theHostsrow for that host and the port state on the array and switch.KF-4092: the template copy on the pool still has disks cloned from it. Delete those disks first.KF-5012: the array refused the operation. Check space and state on the array.The VM fails to start with
Unable to create a deployment: the platform could not place it. Read theHostsrows; the usual cause is a host short of paths.
Task 5: Disable, Maintain, Change Scope, or Delete the Pool
The lifecycle actions are the same as for an iSCSI pool on a managed array. Follow Task 4
in iSCSI Pools on a Managed Array (COMSTAR): disable to stop new
disks, enable maintenance for a window, change scope from Disabled, and delete only
from Maintenance once every disk on the pool is gone.
Deleting the pool removes its views and cached template copies from the array. The
karios-fc target group, its ports, and the host groups stay on the array; delete them
on the array when the last Karios pool is gone.
Limits
No CHAP. Zoning and masking decide access.
No volume snapshots (
KF-4016).No Storage QoS (
KF-4016).Disks can grow but not shrink.
A host without an FC HBA never holds the pool.
Troubleshooting
Code or message |
What it means |
What to do |
|---|---|---|
|
The array did not answer, or answered but the probe failed. |
Check the address, credentials, STMF, and the dataset’s ZFS pool. |
|
The array refused the operation. |
Check space and state on the array. |
|
A host sees fewer of the pool’s ports than |
Zone the host to the missing port, bring the port back, or lower the floor. |
|
The host’s HBA is up but sees none of the array’s ports. |
Use |
|
The host has not reported yet, or not for three minutes. |
Wait a minute, or restart the Karios host service on it. Check that the host service is running. |
|
The host has no FC adapter. |
Scope the pool to a cluster whose hosts have HBAs, or accept |
|
Something outside Karios is logged in to the port. |
Move it off the port, or use another port. |
|
No host could reach the pool for about five minutes. |
Fix the fabric or the array. Placement comes back by itself. |
|
The platform could not place the VM. |
Read the pool’s |
Done Criteria
[ ] The array is registered with a verified SSH host key and at least two ports read
Serving.[ ] Every host in scope reads
Readyand the pool readsUp.[ ] A test disk on a running VM shows
Healthywith one path per array port.[ ] Your team knows that snapshots and CHAP are not available on this pool.