Why store hs ?

[cloneofsimo]

flux/src/flux/modules/autoencoder.py

Lines 159 to 180 in 87f6fff

	def forward(self, x: Tensor) -> Tensor:
	# downsampling
	hs = [self.conv_in(x)]
	for i_level in range(self.num_resolutions):
	for i_block in range(self.num_res_blocks):
	h = self.down[i_level].block[i_block](hs[-1])
	if len(self.down[i_level].attn) > 0:
	h = self.down[i_level].attn[i_block](h)
	hs.append(h)
	if i_level != self.num_resolutions - 1:
	hs.append(self.down[i_level].downsample(hs[-1]))
	# middle
	h = hs[-1]
	h = self.mid.block_1(h)
	h = self.mid.attn_1(h)
	h = self.mid.block_2(h)
	# end
	h = self.norm_out(h)
	h = swish(h)
	h = self.conv_out(h)
	return h

There is hs variable here that is not being used?

[geronimi73]

no idea what this code does but isn't it being used on lines 164, 167, 169 and 172?