I'm trying to generate Go files (mainly structs) from K8S YAML CRD's. The end result would look much like what oapi-codegen does for OpenAPI definitions.
I will be working with ANY arbitrary YAML CRD's, for example:
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
name: subscriptions.operators.coreos.com
spec:
...
status:
...
I've managed to parse it into an Unstructured type, but don't know where to go from there, my code:
...
// 2. List down all the existing crd in the cluster
crdList, err := crdClientSet.ApiextensionsV1().CustomResourceDefinitions().List(context.Background(), metav1.ListOptions{})
if err != nil {
panic(err.Error())
}
// 3. get new empty schema holder
scheme := runtime.NewScheme()
// 4. loop over all the crd and add to the schema
scheme.AddKnownTypeWithName(
schema.GroupVersionKind{
Group: "apiextensions.k8s.io",
Version: "v1",
Kind: "CustomResourceDefinition",
},
&unstructured.Unstructured{},
)
for _, crd := range crdList.Items {
for _, v := range crd.Spec.Versions {
scheme.AddKnownTypeWithName(
schema.GroupVersionKind{
Group: crd.Spec.Group,
Version: v.Name,
Kind: crd.Spec.Names.Kind,
},
&unstructured.Unstructured{},
)
}
}
yamlFile, err := os.ReadFile("subscriptions.operators.coreos.com.yaml")
if err != nil {
panic(err.Error())
}
codecs := serializer.NewCodecFactory(scheme)
// Decode YAML into Unstructured object
obj := &unstructured.Unstructured{}
_, _, err = codecs.UniversalDeserializer().Decode(yamlFile, nil, obj)
if err != nil {
fmt.Printf("Error decoding YAML: %v\n", err)
os.Exit(1)
}
fmt.Printf("%v", obj)
...
This allows me to work with any CRD from the cluster, since it's loaded into my schema.
Now the question is; do any tools/packages exist that allow me to render any Unstructured type into actual Go code much like oapi-codegen does?
I can always implement my own solution but obviously I'm first thoroughly looking into existing solutions :).
I have found Kubebuilder, but that seems to be the other way around, generating YAML definitions from Go structs/code.
CDK8S-CLI does something similar, but "manually" in TypeScript. I'm wondering if there's an existing Go solution before implementing something similar myself. Here's an example of what that tool generates (and that I want to replicate):
package k8s
// PodSpec is a description of a pod.
type PodSpec struct {
// List of containers belonging to the pod.
//
// Containers cannot currently be added or removed. There must be at least one container in a Pod. Cannot be updated.
Containers *[]*Container `field:"required" json:"containers" yaml:"containers"`
// Optional duration in seconds the pod may be active on the node relative to StartTime before the system will actively try to mark it failed and kill associated containers.
//
// Value must be a positive integer.
ActiveDeadlineSeconds *float64 `field:"optional" json:"activeDeadlineSeconds" yaml:"activeDeadlineSeconds"`
// If specified, the pod's scheduling constraints.
Affinity *Affinity `field:"optional" json:"affinity" yaml:"affinity"`
// AutomountServiceAccountToken indicates whether a service account token should be automatically mounted.
AutomountServiceAccountToken *bool `field:"optional" json:"automountServiceAccountToken" yaml:"automountServiceAccountToken"`
// Specifies the DNS parameters of a pod.
//
// Parameters specified here will be merged to the generated DNS configuration based on DNSPolicy.
DnsConfig *PodDnsConfig `field:"optional" json:"dnsConfig" yaml:"dnsConfig"`
// Set DNS policy for the pod.
//
// Defaults to "ClusterFirst". Valid values are 'ClusterFirstWithHostNet', 'ClusterFirst', 'Default' or 'None'. DNS parameters given in DNSConfig will be merged with the policy selected with DNSPolicy. To have DNS options set along with hostNetwork, you have to specify DNS policy explicitly to 'ClusterFirstWithHostNet'.
// Default: ClusterFirst". Valid values are 'ClusterFirstWithHostNet', 'ClusterFirst', 'Default' or 'None'. DNS parameters given in DNSConfig will be merged with the policy selected with DNSPolicy. To have DNS options set along with hostNetwork, you have to specify DNS policy explicitly to 'ClusterFirstWithHostNet'.
//
DnsPolicy *string `field:"optional" json:"dnsPolicy" yaml:"dnsPolicy"`
// EnableServiceLinks indicates whether information about services should be injected into pod's environment variables, matching the syntax of Docker links.
//
// Optional: Defaults to true.
// Default: true.
//
EnableServiceLinks *bool `field:"optional" json:"enableServiceLinks" yaml:"enableServiceLinks"`
// List of ephemeral containers run in this pod.
//
// Ephemeral containers may be run in an existing pod to perform user-initiated actions such as debugging. This list cannot be specified when creating a pod, and it cannot be modified by updating the pod spec. In order to add an ephemeral container to an existing pod, use the pod's ephemeralcontainers subresource.
EphemeralContainers *[]*EphemeralContainer `field:"optional" json:"ephemeralContainers" yaml:"ephemeralContainers"`
// HostAliases is an optional list of hosts and IPs that will be injected into the pod's hosts file if specified.
//
// This is only valid for non-hostNetwork pods.
HostAliases *[]*HostAlias `field:"optional" json:"hostAliases" yaml:"hostAliases"`
// Use the host's ipc namespace.
//
// Optional: Default to false.
// Default: false.
//
HostIpc *bool `field:"optional" json:"hostIpc" yaml:"hostIpc"`
// Specifies the hostname of the Pod If not specified, the pod's hostname will be set to a system-defined value.
Hostname *string `field:"optional" json:"hostname" yaml:"hostname"`
// Host networking requested for this pod.
//
// Use the host's network namespace. If this option is set, the ports that will be used must be specified. Default to false.
// Default: false.
//
HostNetwork *bool `field:"optional" json:"hostNetwork" yaml:"hostNetwork"`
// Use the host's pid namespace.
//
// Optional: Default to false.
// Default: false.
//
HostPid *bool `field:"optional" json:"hostPid" yaml:"hostPid"`
// Use the host's user namespace.
//
// Optional: Default to true. If set to true or not present, the pod will be run in the host user namespace, useful for when the pod needs a feature only available to the host user namespace, such as loading a kernel module with CAP_SYS_MODULE. When set to false, a new userns is created for the pod. Setting false is useful for mitigating container breakout vulnerabilities even allowing users to run their containers as root without actually having root privileges on the host. This field is alpha-level and is only honored by servers that enable the UserNamespacesSupport feature.
// Default: true. If set to true or not present, the pod will be run in the host user namespace, useful for when the pod needs a feature only available to the host user namespace, such as loading a kernel module with CAP_SYS_MODULE. When set to false, a new userns is created for the pod. Setting false is useful for mitigating container breakout vulnerabilities even allowing users to run their containers as root without actually having root privileges on the host. This field is alpha-level and is only honored by servers that enable the UserNamespacesSupport feature.
//
HostUsers *bool `field:"optional" json:"hostUsers" yaml:"hostUsers"`
// ImagePullSecrets is an optional list of references to secrets in the same namespace to use for pulling any of the images used by this PodSpec.
//
// If specified, these secrets will be passed to individual puller implementations for them to use. More info: https://kubernetes.io/docs/concepts/containers/images#specifying-imagepullsecrets-on-a-pod
ImagePullSecrets *[]*LocalObjectReference `field:"optional" json:"imagePullSecrets" yaml:"imagePullSecrets"`
// List of initialization containers belonging to the pod.
//
// Init containers are executed in order prior to containers being started. If any init container fails, the pod is considered to have failed and is handled according to its restartPolicy. The name for an init container or normal container must be unique among all containers. Init containers may not have Lifecycle actions, Readiness probes, Liveness probes, or Startup probes. The resourceRequirements of an init container are taken into account during scheduling by finding the highest request/limit for each resource type, and then using the max of of that value or the sum of the normal containers. Limits are applied to init containers in a similar fashion. Init containers cannot currently be added or removed. Cannot be updated. More info: https://kubernetes.io/docs/concepts/workloads/pods/init-containers/
InitContainers *[]*Container `field:"optional" json:"initContainers" yaml:"initContainers"`
// NodeName is a request to schedule this pod onto a specific node.
//
// If it is non-empty, the scheduler simply schedules this pod onto that node, assuming that it fits resource requirements.
NodeName *string `field:"optional" json:"nodeName" yaml:"nodeName"`
// NodeSelector is a selector which must be true for the pod to fit on a node.
//
// Selector which must match a node's labels for the pod to be scheduled on that node. More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/
NodeSelector *map[string]*string `field:"optional" json:"nodeSelector" yaml:"nodeSelector"`
// Specifies the OS of the containers in the pod.
//
// Some pod and container fields are restricted if this is set.
//
// If the OS field is set to linux, the following fields must be unset: -securityContext.windowsOptions
//
// If the OS field is set to windows, following fields must be unset: - spec.hostPID - spec.hostIPC - spec.hostUsers - spec.securityContext.seLinuxOptions - spec.securityContext.seccompProfile - spec.securityContext.fsGroup - spec.securityContext.fsGroupChangePolicy - spec.securityContext.sysctls - spec.shareProcessNamespace - spec.securityContext.runAsUser - spec.securityContext.runAsGroup - spec.securityContext.supplementalGroups - spec.containers[*].securityContext.seLinuxOptions - spec.containers[*].securityContext.seccompProfile - spec.containers[*].securityContext.capabilities - spec.containers[*].securityContext.readOnlyRootFilesystem - spec.containers[*].securityContext.privileged - spec.containers[*].securityContext.allowPrivilegeEscalation - spec.containers[*].securityContext.procMount - spec.containers[*].securityContext.runAsUser - spec.containers[*].securityContext.runAsGroup
Os *PodOs `field:"optional" json:"os" yaml:"os"`
// Overhead represents the resource overhead associated with running a pod for a given RuntimeClass.
//
// This field will be autopopulated at admission time by the RuntimeClass admission controller. If the RuntimeClass admission controller is enabled, overhead must not be set in Pod create requests. The RuntimeClass admission controller will reject Pod create requests which have the overhead already set. If RuntimeClass is configured and selected in the PodSpec, Overhead will be set to the value defined in the corresponding RuntimeClass, otherwise it will remain unset and treated as zero. More info: https://git.k8s.io/enhancements/keps/sig-node/688-pod-overhead/README.md
Overhead *map[string]Quantity `field:"optional" json:"overhead" yaml:"overhead"`
// PreemptionPolicy is the Policy for preempting pods with lower priority.
//
// One of Never, PreemptLowerPriority. Defaults to PreemptLowerPriority if unset.
// Default: PreemptLowerPriority if unset.
//
PreemptionPolicy *string `field:"optional" json:"preemptionPolicy" yaml:"preemptionPolicy"`
// The priority value.
//
// Various system components use this field to find the priority of the pod. When Priority Admission Controller is enabled, it prevents users from setting this field. The admission controller populates this field from PriorityClassName. The higher the value, the higher the priority.
Priority *float64 `field:"optional" json:"priority" yaml:"priority"`
// If specified, indicates the pod's priority.
//
// "system-node-critical" and "system-cluster-critical" are two special keywords which indicate the highest priorities with the former being the highest priority. Any other name must be defined by creating a PriorityClass object with that name. If not specified, the pod priority will be default or zero if there is no default.
PriorityClassName *string `field:"optional" json:"priorityClassName" yaml:"priorityClassName"`
// If specified, all readiness gates will be evaluated for pod readiness.
//
// A pod is ready when all its containers are ready AND all conditions specified in the readiness gates have status equal to "True" More info: https://git.k8s.io/enhancements/keps/sig-network/580-pod-readiness-gates
ReadinessGates *[]*PodReadinessGate `field:"optional" json:"readinessGates" yaml:"readinessGates"`
// Restart policy for all containers within the pod.
//
// One of Always, OnFailure, Never. Default to Always. More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/#restart-policy
// Default: Always. More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/#restart-policy
//
RestartPolicy *string `field:"optional" json:"restartPolicy" yaml:"restartPolicy"`
// RuntimeClassName refers to a RuntimeClass object in the node.k8s.io group, which should be used to run this pod. If no RuntimeClass resource matches the named class, the pod will not be run. If unset or empty, the "legacy" RuntimeClass will be used, which is an implicit class with an empty definition that uses the default runtime handler. More info: https://git.k8s.io/enhancements/keps/sig-node/585-runtime-class.
RuntimeClassName *string `field:"optional" json:"runtimeClassName" yaml:"runtimeClassName"`
// If specified, the pod will be dispatched by specified scheduler.
//
// If not specified, the pod will be dispatched by default scheduler.
SchedulerName *string `field:"optional" json:"schedulerName" yaml:"schedulerName"`
// SecurityContext holds pod-level security attributes and common container settings.
//
// Optional: Defaults to empty. See type description for default values of each field.
// Default: empty. See type description for default values of each field.
//
SecurityContext *PodSecurityContext `field:"optional" json:"securityContext" yaml:"securityContext"`
// DeprecatedServiceAccount is a depreciated alias for ServiceAccountName.
//
// Deprecated: Use serviceAccountName instead.
ServiceAccount *string `field:"optional" json:"serviceAccount" yaml:"serviceAccount"`
// ServiceAccountName is the name of the ServiceAccount to use to run this pod.
//
// More info: https://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/
ServiceAccountName *string `field:"optional" json:"serviceAccountName" yaml:"serviceAccountName"`
// If true the pod's hostname will be configured as the pod's FQDN, rather than the leaf name (the default).
//
// In Linux containers, this means setting the FQDN in the hostname field of the kernel (the nodename field of struct utsname). In Windows containers, this means setting the registry value of hostname for the registry key HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters to FQDN. If a pod does not have FQDN, this has no effect. Default to false.
// Default: false.
//
SetHostnameAsFqdn *bool `field:"optional" json:"setHostnameAsFqdn" yaml:"setHostnameAsFqdn"`
// Share a single process namespace between all of the containers in a pod.
//
// When this is set containers will be able to view and signal processes from other containers in the same pod, and the first process in each container will not be assigned PID 1. HostPID and ShareProcessNamespace cannot both be set. Optional: Default to false.
// Default: false.
//
ShareProcessNamespace *bool `field:"optional" json:"shareProcessNamespace" yaml:"shareProcessNamespace"`
// If specified, the fully qualified Pod hostname will be "<hostname>.<subdomain>.<pod namespace>.svc.<cluster domain>". If not specified, the pod will not have a domainname at all.
Subdomain *string `field:"optional" json:"subdomain" yaml:"subdomain"`
// Optional duration in seconds the pod needs to terminate gracefully.
//
// May be decreased in delete request. Value must be non-negative integer. The value zero indicates stop immediately via the kill signal (no opportunity to shut down). If this value is nil, the default grace period will be used instead. The grace period is the duration in seconds after the processes running in the pod are sent a termination signal and the time when the processes are forcibly halted with a kill signal. Set this value longer than the expected cleanup time for your process. Defaults to 30 seconds.
// Default: 30 seconds.
//
TerminationGracePeriodSeconds *float64 `field:"optional" json:"terminationGracePeriodSeconds" yaml:"terminationGracePeriodSeconds"`
// If specified, the pod's tolerations.
Tolerations *[]*Toleration `field:"optional" json:"tolerations" yaml:"tolerations"`
// TopologySpreadConstraints describes how a group of pods ought to spread across topology domains.
//
// Scheduler will schedule pods in a way which abides by the constraints. All topologySpreadConstraints are ANDed.
TopologySpreadConstraints *[]*TopologySpreadConstraint `field:"optional" json:"topologySpreadConstraints" yaml:"topologySpreadConstraints"`
// List of volumes that can be mounted by containers belonging to the pod.
//
// More info: https://kubernetes.io/docs/concepts/storage/volumes
Volumes *[]*Volume `field:"optional" json:"volumes" yaml:"volumes"`
}