The Solar Oracle Walkman: Difference between revisions
m (→Discussion) |
|||
| Line 100: | Line 100: | ||
= Discussion = | = Discussion = | ||
The design of solar mini disc walkman is not only a music design project involved with latent space in AI, the result also open another interesting topic "can | The design of solar mini disc walkman is not only a music design project involved with latent space in AI, the result also open another interesting topic "can energy be treatable and. traded?" Blockchain and crypto currency technology opens the possibility to trade digital assets with encryption trust but yet the energy trade due to the vulnerabilities in hardware anti-counterfeiting mechanisms in the . The design of the solar finger prints or solar tattoo might provide a solution. | ||
=References= | =References= | ||
Revision as of 16:04, 24 August 2025
-
Sony WM-F107 exhibited in Solar Biennale 2025 in Lausanne.
Abstract
This multidisciplinary research is a composition of DIY solar practice, conceptual music and the exploration of latent space of AI. A “solar mini-disc walkman” is prototyped that turns a handmade dye-sensitized solar cell (DSSC) into music. Central to the design is a 7-dimensional I–V “fingerprint”: the unique curve of each handmade DSSC is treated as a musical score, translating its photovoltaic character into reproducible, generative sound. Reinvented from a DIY I–V tester, the device is self-powered: a 6×6 cm “solar mini disc” can be inserted and rendered to audio in real time. Machine learning provides the medium for this translation. The sound engine is implemented in Max/MSP with RAVE, a neural audio synthesizer whose latent space encodes timbral variation. At present, the I–V fingerprint is manually mapped to the decoder’s latent inlets—an intentionally minimal design that prioritizes real-time responsiveness and artistic control. Beyond sculptural experimentation, this sound mapping not only produces reproducible sonic identities for each cell, but also gestures toward a broader research question: how the “semantics” of energy and sound might be aligned across systems in a universal latent space. At the same time, the project fosters the systematic collection of natural-dyed DSSC data and invites a discussion of whether—and how—solar energy could be made traceable.
┌────────────────────┐
│ DSSC I–V Features │ (7D fingerprint)
│ [FF, Vmpp/Voc, │
│ Impp/Isc, Rs, │
│ Rsh, curvature, │
│ area] │
└────────┬───────────┘
│
▼
┌──────────────────────┐
│ vec2vec-style │
│ Bridge Mapping │
│ (priors: monotonic, │
│ smoothness, etc.) │
└─────────┬────────────┘
│
▼
┌──────────────────────┐
│ RAVE Latent Space │
│ (semantic geometry, │
│ VSP constraints) │
└─────────┬────────────┘
│
▼
┌──────────────────────┐
│ Sound Synthesis │
│ (real-time audio │
│ decoder in nn~) │
└──────────────────────┘
-
The DIY I-V tester made by Marc Dusseiller.
-
The measurement of the I-V curve tester is uploaded to Thingspeak and a local server, and can be fetched in Max/MSP.
-
DIY DSSC with screen printed pattern and hollyhock dye made by Shih Wei Chieh.
-
DIY DSSC with cyanotype pattern made by Shih Wei Chieh.
Experiment
Converting physics to music with hash operation
The audio output of each "solar disc" are expected to be reproducible, generative and variational, like a period of generative music with clear mechanism rather than completely randomness. To make each solar glass a generative device, I firstly assume I need to design a hash operation to gain a “finger print (F)” for each solar glass; A hash operation is the process of feeding input data such as numbers, text, files, or a set of I-V curve parameters—into a mathematical function or algorithm to produce a hash value. Hash algorithms can take input of any length but always generate a fixed-length output. They are designed to be fast to compute, yield the same output for the same input, and produce drastically different outputs when the input changes even slightly. Here are some notes about how the hash operation and the composition of generative mechanism is designed in Max/MSP.
The finger prints raw features
As we know I-V curve is often used to analysis the characteristics of a solar cell, therefore it is ideally the finger print of the panel. In this research, the shape of I-V curve is deconstructed into to 7 features that are often used to measure different characteristics of the panel, and then apply machine learning to each feature so the shape can be learned by the computer. This method is expected to ensures the irradiance invariance, so the reproducibility of the audio output of the solar disc will be resilient even it's put under different light exposure. The finger prints F consists 7 features of the I-V curve: F = [FF (Fill Factor), Vmpp/Voc, Impp/Isc, Rs (series resistance), Rsh (shunting resistance), sum of curvature, total area of the I-V curve]. Noticing the calculation made here are dimensionless. A dimensionless feature vector is a set of numerical descriptors that have been normalized so they no longer carry physical units such as volts, amperes, or ohms. By converting raw measurements into dimensionless quantities—for example, by taking ratios like Vmpp/Voc or Impp/Isc, the features capture only the relative shape or behavior of the data, independent of its absolute scale. This process is crucial when comparing or classifying I-V curves under varying light intensities, as it ensures that differences in the vector reflect intrinsic device characteristics rather than changes in measurement conditions. The feature definitions (scale-free) are listed below, and a script of javascript is created by GPT to generate these 7 features in a Max patch:
The 7-D fingerprint is defined as:
F = [FF, Vmpp/Voc, Impp/Isc, Rs*, Rsh*, Σκ, A*]
All features are computed on a 64-point resampled I–V trace and normalized by Voc and Isc to be invariant to irradiance and device size.
- FF (fill factor)
FF = (Vmpp * Impp) / (Voc * Isc)
- Vmpp/Voc and Impp/Isc
- Scale-free ratios capturing the operating point at maximum power.
- Rs* and Rsh* (dimensionless ohmic estimates)
- First estimate the local slopes on the resampled curve:
Rs ≈ -ΔV/ΔI (evaluated near I ≈ Isc)Rsh ≈ -ΔV/ΔI (evaluated near V ≈ Voc)- Then report dimensionless forms:
Rs* = Rs * (Isc / Voc)Rsh* = Rsh * (Isc / Voc)
- Σκ (curvature_sum)
- Sum of absolute turning angles along the 64-point polyline of the I–V trace: for each consecutive pair of segments
s_i = (ΔV_i, ΔI_i), accumulate |angle(s_i, s_{i+1})|, and reportΣκ = Σ |angle(s_i, s_{i+1})|.- (Intuition: larger Σκ indicates a more “bent” I–V shape.)
- A* (normalized area under the I–V curve)
- Definition: area from V=0 to V=Voc divided by
(Isc * Voc). - Discrete approximation on the resampled trace:
A* ≈ (Σ I[i] * ΔV[i]) / (Isc * Voc)
Ml.scale and ml.principle
To achieve the goal to recognize the shape of each "solar mini disc", ml.* library in Max/MSP could be a possible solution. Ml.* is a toolbox of machine learning algorithms implemented in Max to enable real-time interactive music and video with unsupervised machine learning, aimed at computer musicians and artists. The I-V curve tester is connected to computer and the 16 points of voltage and current measurements are sent to the computer via serial communications. The raw 7 features are first sent to ml.scale object for the normalization in range from 0 to 1. The values are then passed to ml.principle, which performs Principal Component Analysis (PCA). This converts the 7 values into a new 7-dimensional PCA space, though typically only the first two components (PC1 and PC2) carry most of the significant variance. In short, PCA is a mathematical method that rotates and compresses data into fewer dimensions while preserving as much variance as possible. ml.principle is the Max/MSP object that implements PCA: it learns the principal axes from training data, and then projects new data into that reduced space.
-
An example Max patch of the machine learning process for the raw 7 features: [FF, Vmpp/Voc, Impp/Isc, Rs, Rsh, curvature_sum, area].
-
The mathematical explanation for the principle component analysis (PCA) made by GPT.
From sound reproducibility to semantic stability (VSP)
At present, the sound engine is implemented in Max/MSP with RAVE, where a 7-dimensional I–V “fingerprint” is directly connected to the decoder’s latent inlets. This pragmatic choice exploits RAVE’s real-time, high-fidelity synthesis, but the mapping remains mainly hand-crafted.
Framing the process more generally, the mapping can be understood as a vec2vec-style cross-modal alignment: a bridge function projects photovoltaic features into the latent space of a neural audio synthesizer. According to Jha et al. (2025), In the vec2vec framework, semantic stability is maintained through three key constraints: reconstruction (the translated representation can be mapped back to the source), cycle-consistency (round-trips preserve meaning), and vector space preservation (VSP), which ensures that pairwise distances among embeddings remain intact across the mapping. While these methods were developed for aligning text embeddings, they provide a useful reference for future design: similar constraints could regulate how photovoltaic features enter the RAVE latent space, ensuring that sonic identities preserve the geometric relationships of their underlying energy curves.
In that sense, the Solar Mini-Disc Walkman not only produces reproducible sonic identities for each handmade DSSC, but also gestures toward a broader research question: how cross-system “languages” of energy and sound might be aligned in a universal latent space. Although the current mapping is deliberately naive—simply wiring the seven raw DSSC features into the decoder inlets of RAVE—it already achieves strong reproducibility. Each solar cell yields a stable and unique sonic output whenever measured, which effectively functions as a sonic fingerprint. In this stage, semantic preservation and vector space alignment are not the focus; the priority is ensuring that the physical identity of each DSSC is consistently rendered as an audible identity.
-
A simple sound map diagram of I-V data and RAVE latent space.
The dataset training of RAVE
Discussion
The design of solar mini disc walkman is not only a music design project involved with latent space in AI, the result also open another interesting topic "can energy be treatable and. traded?" Blockchain and crypto currency technology opens the possibility to trade digital assets with encryption trust but yet the energy trade due to the vulnerabilities in hardware anti-counterfeiting mechanisms in the . The design of the solar finger prints or solar tattoo might provide a solution.
References
- Jha, Rishi, Collin Zhang, Vitaly Shmatikov, and John X. Morris. 2025. “Harnessing the Universal Geometry of Embeddings.” arXiv:2505.12540. Preprint, arXiv, June 25. https://doi.org/10.48550/arXiv.2505.12540.
- https://www.hackteria.org/wiki/A_RAVE_and_starvation_synth_based_generative_sonic_device_powered_by_dye_sensitized_solar_cell
- https://github.com/shihweichieh2023/IVcurve_tester
- https://github.com/rjha18/vec2vec