Feeds

Last time I used a previous post's DAG Hamilton graphviz output to generate a series of functionally highlighted DAG Hamilton workflow graphs. The  SVG (scalable vector graphics) versions of these graphs will serve as the input for this post.

I was dissatisfied with the quality of the PNG output, or at least how it rendered, fuzzy and illegible. My thought was that an SVG presentation would provide a more crisp, scalable (hence the name SVG) view of each graph.

Where I ran into problems was the embedded logos. Applications like PowerPoint allowed the inclusion of the logos as SGV "images" within the SVG "image" in PowerPoint, but did not render them; blank spaces remained.

So I set out to embed the SVG of the logos inline as elements within the final SVG file; it turned into quite the journey . . .

So SVG is really just XML, right? No, it is XML; it's just not just XML. There are XML tags and what is inside those tags can contain multiple SVG characteristics, all in their own syntax, most listed as quoted text.

At this point finding a library that allows for programmatic manipulation of SGV by tag or reviewing some open source browser source code may have helped. I did not do either of those things (a brief internet search yielded Python libraries, but they seemed focused more on conversion to and from SVG and other image formats) and set out on my own.

Like most people, I have played with Inkscape and converted images to SVG format. I even blogged about having done this with POVRay rendered pysanky eggs back in the day. Using something with software written by people way smarter than you and actually understanding it are two entirely different animals.

To make matters worse . . . I cannot actually display the SVG images or inline them here on Blogger. Smaller SVG snippets seem to work, but an entire graph with SVG logos is either too much or I am doing something wrong. Another (blurry) PNG example of the output will have to do.

Important concepts with links:

1) viewBox, scale, dimensions - Soueiden (classic, kind of the standard as far as I can tell):

https://www.sarasoueidan.com/blog/mimic-relative-positioning-in-svg/

2) the four quadrants of svg space (but you only see the lower right):

http://dh.obdurodon.org/coordinate-tutorial.xhtml

3) use x, y positioning to place embedded SVG rather than viewBox coordinates:

I have lost the link, but whoever suggested this, thank you.

4) (no link) Allow graphviz to do as much work as possible before editing any svg. For instance, when bolding edges of the graph in SVG, the edges will invariably overlap the nodes. This looks ugly. graphviz handles all that and it is far far simpler than trying to do it on your own.

5) bezier curves - nothing in this post about them, but they were part of my real introduction to SVG, and the most fun part. Recommend.

https://javascript.info/bezier-curve#de-casteljau-s-algorithm

Methodology for putting SVG logos inside the SVG document (not necessarily in order):

1) scale the embedded SVGs with the "width" and "height" attributes (SVG). I made mine proportional relative to the original SVGs' dimensions.

2) Calculate where the SVGs are supposed to go within the graphviz generated SVG coordinate space.

graphviz pushes everything into the upper right SVG space quadrant with an SVG "translate" command with 4 units padding. This needs to be taken into account when positioning the SVG elements relative to graphviz' coordinate space. The elements will be using the lower right SVG space quadrant coordinate space.

3) Leverage the positioning and size of the original PNG logos to place your SVG ones, then pop the old logo image elements and "erase" the boxes around them (yes, quite hacky, but effective).

This is a Python blog. Nutshell: I used xml.etree.ElementTree and rudimentary text processing of the SVG specific parts to get this done.

The whole thing got quite unwieldy and I turned once again to DAG Hamilton to help me organize and visualize things. (Blurry) screenshot below:

Wow, it looks like you just collected every piece of information you could about all the dimensions and smashed it all together in the final SVG document at the end.

Yes.

Hey, why is that one node just hanging out at a dead end not doing anything?

I was not getting the whole coordinate thing and needed it for reference.

The code:

# run.py - the DAG Hamilton control file.

"""Hamilton wrapper."""
# https://hamilton.dagworks.io/en/latest/concepts/driver/#recap
import sys
import pprint
from hamilton import driver
import editsvgs as esvg
OUTPUTFILES = {'data_source_highlighted':'data_source_highlighted_final',               'web_scraping_functions_highlighted':'web_scraping_functions_highlighted_final',               'output_functions_highlighted':'output_functions_highlighted_final'}
dr = driver.Builder().with_modules(esvg).build()
dr.display_all_functions('esvg.svg', deduplicate_inputs=True, keep_dot=True, orient='BR')
for keyx in OUTPUTFILES:    results = dr.execute(['hamilton_logo_root',                          'company_logo_root',                          'graph_root',                          'doc_attrib',                          'hamilton_logo_tree_indices',                          'company_logo_tree_indices',                          'hamilton_logo_png_attrib',                          'company_logo_png_attrib',                          'parsed_hamiltonlogo_png_attrib',                          'parsed_companylogo_png_attrib',                          'biggerdimension',                          'dimensionratio',                          'parsed_graph_dimensions',                          'hamilton_logo_position',                          'hamilton_svg_dimensions',                          'hamilton_logo_dimensions_orig',                          'biggerdimension_company',                          'dimensionratio_company',                          'company_logo_position',                          'company_svg_dimensions',                          'company_logo_dimensions_orig',                          'final_svg_file'],                          inputs={'hamiltonlogofile':'hamiltonlogolarge.svg',                                  'companylogofile':'fauxcompanylogo.svg',                                  'testfile':keyx + '.svg',                                  'outputfile':OUTPUTFILES[keyx] + '.svg',                                  'hamiltonlogopng':'hamiltonlogolarge.png',                                  'companylogopng':'fauxcompanylogo.png'})        print('\ndoc_attrib =\n')    pprint.pprint(results['doc_attrib'])    print('\nhamilton_logo_tree_indices =\n')    pprint.pprint(results['hamilton_logo_tree_indices'])    print('\ncompany_logo_tree_indices =\n')    pprint.pprint(results['company_logo_tree_indices'])    print('\nhamilton_logo_png_attrib =\n')    pprint.pprint(results['hamilton_logo_png_attrib'])    print('\nparsed_hamiltonlogo_png_attrib =\n')    pprint.pprint(results['parsed_hamiltonlogo_png_attrib'])    print('\ncompany_logo_png_attrib =\n')    pprint.pprint(results['company_logo_png_attrib'])    print('\nparsed_companylogo_png_attrib =\n')    pprint.pprint(results['parsed_companylogo_png_attrib'])    print('\nbiggerdimension =\n')    pprint.pprint(results['biggerdimension'])    print('\ndimensionratio =\n')    pprint.pprint(results['dimensionratio'])    print('\nparsed_graph_dimensions =\n')    pprint.pprint(results['parsed_graph_dimensions'])    print('\nhamilton_logo_position =\n')    pprint.pprint(results['hamilton_logo_position'])    print('\nhamilton_svg_dimensions =\n')    pprint.pprint(results['hamilton_svg_dimensions'])    print('\nhamilton_logo_dimensions_orig =\n')    pprint.pprint(results['hamilton_logo_dimensions_orig'])    print('\ndimensionratio_company =\n')    pprint.pprint(results['dimensionratio_company'])    print('\ncompany_logo_position =\n')    pprint.pprint(results['company_logo_position'])    print('\ncompany_svg_dimensions =\n')    pprint.pprint(results['company_svg_dimensions'])    print('\ncompany_logo_dimensions_orig =\n')    pprint.pprint(results['company_logo_dimensions_orig'])    print('\nfinal_svg_file =\n')    pprint.pprint(results['final_svg_file'])
# editsvgs.py - DAG Hamilton noun-named functions.

# python 3.12
"""Attempt to position svg logos and editflowchart with svg."""
import os
import pprint
import xml.etree.ElementTree as ET
import itertools
import sys
import copy
import reusedfunctions as rf
# Pop this to get rid of png image.# '{http://www.w3.org/1999/xlink}href': 'hamiltonlogolarge.png'}PNG_ATTRIB_KEY = '{http://www.w3.org/1999/xlink}href'# '{http://www.w3.org/1999/xlink}href': 'fauxcompanylogo.png'}
def hamilton_logo_root(hamiltonlogofile:str) -> ET.Element:    """    Get root of ElementTree object for Hamilton    logo svg file.
    hamiltonlogofile is the svg file with the Hamilton logo.    """    print('Getting Hamilton logo svg file root Element . . .')    return rf.getroot(hamiltonlogofile)
def company_logo_root(companylogofile:str) -> ET.Element:    """    Get root of ElementTree object for company    logo svg file.
    companylogofile is the svg file with the company logo.    """    print('Getting company logo svg file root Element . . .')    return rf.getroot(companylogofile)
def graph_root(testfile:str) -> ET.Element:    """    Gets root Element of graphviz graph svg.
    testfile is the graphviz svg file.    """    print('Getting root Element of main graph svg file . . .')    return rf.getroot(testfile)
def doc_attrib(graph_root:ET.Element) -> dict:    """    Gets graphviz svg document's dimensions and viewBox    in a dictionary.
    graph_root is the graphviz svg file root Element. 
    Returns dictionary of xml/svg data for doc.    """    print('Getting dimensions and viewBox for main graph svg file . . .')    return graph_root.attrib
def hamilton_logo_tree_indices(graph_root:ET.Element, hamiltonlogopng:str) -> tuple:    """    Get tree indices (3 deep) for original png    Hamilton logo on graph.
    graph_root is the root Element of graphviz graph svg.
    hamiltonlogopng is the name of the png file referenced    in the image link in the svg file (string).
    Returns 3 tuple of integers.    """    print('Getting ElementTree indices for tree for Hamilton png logo Element . . .')    return rf.gettreeindices(graph_root, hamiltonlogopng)
def company_logo_tree_indices(graph_root:ET.Element, companylogopng:str) -> tuple:    """    Get tree indices (3 deep) for original png    company logo on graph.
    graph_root is the root Element of graphviz graph svg.
    companylogopng is the name of the png file referenced    in the image link in the svg file (string).
    Returns 3 tuple of integers.    """    print('Getting ElementTree indices for tree for company png logo Element . . .')    return rf.gettreeindices(graph_root, companylogopng)
def hamilton_logo_png_attrib(graph_root:ET.Element, hamilton_logo_tree_indices:tuple) -> dict:    """    Get attrib dictionary for original Hamilton png file Element in graph svg.
    graph_root is the root Element of graphviz graph svg.
    hamilton_logo_tree_indices are the lookup indices for the Hamilton    logo png Element within the xml tree.    """    print('Getting attrib dictionary for original Hamilton png file Element in graph svg . . .')    return rf.getpngattrib(graph_root, hamilton_logo_tree_indices)
def company_logo_png_attrib(graph_root:ET.Element, company_logo_tree_indices:tuple) -> dict:    """    Get attrib dictionary for original company png file Element in graph svg.
    graph_root is the root Element of graphviz graph svg.
    company_logo_tree_indices are the lookup indices for the company    logo png Element within the xml tree.    """    print('Getting attrib dictionary for original company png file Element in graph svg . . .')    return rf.getpngattrib(graph_root, company_logo_tree_indices)
def parsed_hamiltonlogo_png_attrib(hamilton_logo_png_attrib:dict) -> dict:    """    Work dictionary that has information on former    location of png Hamilton logo image in the     graphviz svg.
    Basically getting svg text values into float format.
    Returns new dictionary.    """    print('Getting svg text values into float format for Hamilton png Element . . .')    return rf.parsepngattrib(hamilton_logo_png_attrib)
def parsed_companylogo_png_attrib(company_logo_png_attrib:dict) -> dict:    """    Work dictionary that has information on former    location of png company logo image in the     graphviz svg.
    Basically getting svg text values into float format.
    Returns new dictionary.    """    print('Getting svg text values into float format for company logo png Element . . .')    return rf.parsepngattrib(company_logo_png_attrib)
def biggerdimension(hamilton_logo_root:ET.Element) -> str:    """    hamilton_logo_root is the ElementTree Element    for the big svg Hamilton logo.
    Returns 'Y' if the y dimension is the     bigger one, and 'X' if the x one is.
    Returns None if there is a key error.    """    print('Determining bigger dimension for svg Hamilton logo . . .')    return rf.getbiggerdimension(hamilton_logo_root)
def dimensionratio(biggerdimension:str, hamilton_logo_root:ET.Element) -> float:    """    biggerdimension is a string, 'X' or 'Y'.
    hamilton_logo_root is the ElementTree Element    for the big svg Hamilton logo.
    Returns ratio of bigger dimension    to smaller one (float).    """    print('Calculating dimensions ratio for Hamilton logo svg . . .')    return rf.getdimensionratio(biggerdimension, hamilton_logo_root)
def parsed_graph_dimensions(graph_root:ET.Element) -> tuple:    """    Get translate coordinates from graphviz    svg root Element.
    Returns two tuple of x, y translation.    """    graph0dimensions = graph_root[0].attrib    coordstr = graph0dimensions['transform']    coordstr = coordstr[coordstr.index('translate'):]    coordstr = coordstr[coordstr.index('(') + 1:-1]    vals = [float(x) for x in coordstr.split(' ')]    return tuple(vals)
def hamilton_logo_position(parsed_graph_dimensions:tuple,                           parsed_hamiltonlogo_png_attrib:dict) -> tuple:    """    parsed_graph_dimensions is an x, y two tuple.
    parsed_hamiltonlogo_png_attrib is a dictionary.
    Returns x, y position of Hamilton logo svg graphic as a    two tuple.    """    print('Getting position of Hamilton logo . . .')    return rf.getposition(parsed_graph_dimensions, parsed_hamiltonlogo_png_attrib)
def company_logo_position(parsed_graph_dimensions:tuple,                          parsed_companylogo_png_attrib:dict) -> tuple:    """    parsed_graph_dimensions is an x, y two tuple.
    parsed_hamiltonlogo_png_attrib is a dictionary.
    Returns x, y position of company logo svg graphic as a    two tuple.    """    print('Getting position of company logo . . .')    # Add 4.    x = parsed_companylogo_png_attrib['X'] + parsed_graph_dimensions[0]    # Add negative number with big absolute value.    # Upper right quadrant translation thing.    y = parsed_companylogo_png_attrib['Y'] + parsed_graph_dimensions[1]     return x, y
def hamilton_svg_dimensions(parsed_hamiltonlogo_png_attrib:dict,                            biggerdimension:str,                            dimensionratio:float) -> tuple:    """    Get width and height of svg Hamilton logo within    final document.
    parsed_hamiltonlogo_png_attrib is the dictionary of    numeric values associated with the original image    position of the Hamilton png logo within the    svg document.
    biggerdimension is the 'X' or 'Y' value that    indicates which dimension is the larger of    the two.
    dimensionratio is the ratio of the larger    dimension to the smaller one.
    Returns x, y two tuple of floats.    """    print('Getting size of Hamilton logo in final doc . . .')    return rf.getdimensions(parsed_hamiltonlogo_png_attrib, biggerdimension, dimensionratio)
def hamilton_logo_dimensions_orig(hamilton_logo_root:ET.Element) -> tuple:    """    hamilton_logo_root is the ElementTree Element    for the big svg Hamilton logo.
    Returns two tuple of width, height.    """    print('Retrieving dimensions of Hamilton logo svg . . .')    return rf.getdimensionsorig(hamilton_logo_root)
def final_svg_file(testfile:str,                   outputfile:str,                   hamilton_logo_root:ET.Element,                   hamilton_logo_tree_indices:tuple,                   hamilton_logo_position:tuple,                   hamilton_svg_dimensions:tuple,                   hamilton_logo_dimensions_orig:tuple,                   company_logo_tree_indices:tuple,                   parsed_companylogo_png_attrib:dict,                   company_logo_position:tuple,                   company_logo_root:ET.Element,                   company_svg_dimensions:tuple,                   company_logo_dimensions_orig:tuple,                   ) -> str:    """    Replaces image logos with scaleable    svg ones.
    testfile is the name of the original svg file.
    outputfile is the name of the intended final    svg file.
    hamilton_logo_root is the elementree root object    for the Hamilton logo svg file.
    hamilton_logo_tree_indices are nested indices     indicating the location of the original Hamilton    logo png elementree Element within the input    svg document.
    hamilton_logo_position - x, y tuple - where to    put the svg Hamilton logo within the final    svg document.
    hamilton_svg_dimensions - x, y tuple - width and    height of Hamilton svg logo within the final    svg document.
    hamilton_logo_dimensions_orig - two tuple of width, height    of original svg file Hamilton logo.
    company_logo_tree_indices are nested indices     indicating the location of the original company    logo png elementree Element within the input    svg document.
    company_logo_position - x, y tuple - where to    put the svg company logo within the final    svg document.
    company_logo_root is the elementree root object    for the company logo svg file.     company_svg_dimensions - x, y tuple - width and    height of company svg logo within the final    svg document.
    company_logo_dimensions_orig - two tuple of width, height    of original svg file company logo.
    Returns string filename.    """    print('Making changes to svg . . .')    hlti = hamilton_logo_tree_indices     retval = outputfile    tree = ET.parse(testfile)    root = tree.getroot()    # pop Hamilton png    print('Popping original Hamilton png logo . . .')    root[hlti[0]][hlti[1]][hlti[2]].attrib.pop(PNG_ATTRIB_KEY)    print('Appending Hamilton svg to root Element . . .')    root.append(hamilton_logo_root)    print('Adjusting viewBox for Hamilton svg . . .')    root[-1].attrib['viewBox'] = '0.00 0.00 {0:.3f} {1:.3f}'.format(*hamilton_logo_dimensions_orig)    print('Adjusting height and width for Hamilton svg . . .')    root[-1].attrib['height'] = str(hamilton_svg_dimensions[1])    root[-1].attrib['width'] = str(hamilton_svg_dimensions[0])    print('Positioning Hamilton logo svg within final svg . . .')    root[-1].attrib['x'] = str(hamilton_logo_position[0])    root[-1].attrib['y'] = str(hamilton_logo_position[1])    print('Erasing Hamilton logo bounding box . . .')    # After popping png, polygon resides one index unit back.    root[hlti[0]][hlti[1]][hlti[2] - 1].attrib['stroke'] = 'none'    clti = company_logo_tree_indices    # pop company png    print('Popping original company png logo . . .')    root[clti[0]][clti[1]][clti[2]].attrib.pop(PNG_ATTRIB_KEY)    print('Adding company logo svg Element to main svg file . . .')    root.append(company_logo_root)    print('Adjusting viewBox for company svg . . .')    root[-1].attrib['viewBox'] = '0.00 0.00 {0:.3f} {1:.3f}'.format(*company_logo_dimensions_orig)    print('Adjusting height and width for company svg . . .')    root[-1].attrib['height'] = str(company_svg_dimensions[1])    root[-1].attrib['width'] = str(company_svg_dimensions[0])    print('Moving company logo svg to the correct position in the display . . .')    # Had to adjust 15 units to get it out of the way of the legend.    root[-1].attrib['x'] = str(company_logo_position[0] - 15)    root[-1].attrib['y'] = str(company_logo_position[1])    print('Erasing company logo bounding box . . .')    # After popping png, polygon resides one index unit back.    root[clti[0]][clti[1]][clti[2] - 1].attrib['stroke'] = 'none'    print('Writing new svg . . .')    tree.write(retval)    return retval
def biggerdimension_company(company_logo_root:ET.Element) -> str:    """    company_logo_root is the ElementTree Element    for the big svg company logo.
    Returns 'Y' if the y dimension is the     bigger one, and 'X' if the x one is.    """    print('Determining bigger dimension for svg company logo . . .')    return rf.getbiggerdimension(company_logo_root)
def dimensionratio_company(biggerdimension_company:str,                           company_logo_root:ET.Element) -> float:    """    biggerdimension is a string, 'X' or 'Y'.
    company_logo_root is the ElementTree Element    for the big svg company logo.
    Returns ratio of bigger dimension    to smaller one (float).    """    print('Calculating dimensions ratio for company logo svg . . .')    return rf.getdimensionratio(biggerdimension_company,                                company_logo_root)
def company_logo_position(parsed_graph_dimensions:tuple,                          parsed_companylogo_png_attrib:dict) -> tuple:    """    parsed_graph_dimensions is an x, y two tuple.
    parsed_companylogo_png_attrib is a dictionary.
    Returns x, y position of company logo svg graphic as a    two tuple.    """    print('Getting position of company logo . . .')    return rf.getposition(parsed_graph_dimensions,                          parsed_companylogo_png_attrib)
def company_svg_dimensions(parsed_companylogo_png_attrib:dict,                           biggerdimension_company:str,                           dimensionratio_company:float) -> tuple:    """    Get width and height of svg company logo within    final document.
    parsed_companylogo_png_attrib is the dictionary of    numeric values associated with the original image    position of the company png logo within the    svg document.
    biggerdimension is the 'X' or 'Y' value that    indicates which dimension is the larger of    the two.
    dimensionratio_company is the ratio of the larger    dimension to the smaller one.
    Returns x, y two tuple of floats.    """    pprint.pprint(parsed_companylogo_png_attrib)    print('Getting size of company logo in final doc . . .')    return rf.getdimensions(parsed_companylogo_png_attrib,                             biggerdimension_company,                            dimensionratio_company)
def company_logo_dimensions_orig(company_logo_root:ET.Element) -> tuple:    """    company_logo_root is the ElementTree Element    for the big svg company logo.
    Returns two tuple of width, height.    """    print('Retrieving dimensions of company logo svg . . .')    return rf.getdimensionsorig(company_logo_root)

# reusedfunctions.py - utility/helper/main functionality
#                      at a granular level.

# python 3.12
"""Auxiliary module to Hamilton svg script."""
import itertools
import xml.etree.ElementTree as ET
# Pop this to get rid of png image.# '{http://www.w3.org/1999/xlink}href': 'hamiltonlogolarge.png'}PNG_ATTRIB_KEY = '{http://www.w3.org/1999/xlink}href'
def gettreeindices(graph_root, png):    """    Get tree indices (3 deep) for png on graph.
    graph_root is the root Element of graphviz graph svg.
    png is the name of the png file referenced    in the image link in the svg file (string).
    Returns 3 tuple of integers.    """    countergeneratorx = itertools.count()    counterx = next(countergeneratorx)    for nodex in graph_root:        countergeneratory = itertools.count()        countery = next(countergeneratory)        for nodey in nodex:            countergeneratorz = itertools.count()            counterz = next(countergeneratorz)            for nodez in nodey:                if PNG_ATTRIB_KEY in nodez.attrib:                    if nodez.attrib[PNG_ATTRIB_KEY] == png:                        return counterx, countery, counterz                counterz = next(countergeneratorz)            countery = next(countergeneratory)        counterx = next(countergeneratorx)
def getroot(filename):    """    Get root of ElementTree object for svg file.
    filename is the svg file string.    """    return ET.parse(filename).getroot()
def getpngattrib(graph_root, indices):    """    Get attrib dictionary for png file Element in graph svg.
    graph_root is the root Element of graphviz graph svg.
    indices are the lookup indices for the     png Element within the xml tree.    """    return graph_root[indices[0]][indices[1]][indices[2]].attrib
def parsepngattrib(attrib):    """    Work dictionary that has information on    location of png image in the     graphviz svg.
    Basically getting svg text values into float format.
    Returns new dictionary.    """    retval = {}    retval['X'] = float(attrib['x'])    retval['Y'] = float(attrib['y'])    retval['height'] = float(attrib['height'][:attrib['height'].index('px')])    retval['width'] = float(attrib['width'][:attrib['width'].index('px')])    return retval
def getbiggerdimension(root):    """    root is the ElementTree Element    for the svg file element to be    embedded into the main svg file.
    Returns 'Y' if the y dimension is the     bigger one, and 'X' if the x one is.
    Returns None if there is a key error.    """    dimensions = root.attrib    try:        if float(dimensions['height']) > float(dimensions['width']):            return 'Y'        else:            # X bigger or equal            return 'X'    except ValueError:        pass    return None
def getdimensionratio(biggerdimension, root):    """    biggerdimension is a string, 'X' or 'Y'.
    root is the etree Element for the    svg Element that is to be embedded    into the final svg file
    Returns ratio of bigger dimension    to smaller one (float).    """    dimensions = root.attrib    if biggerdimension == 'Y':        return float(dimensions['height']) / float(dimensions['width'])    else:        return float(dimensions['width']) / float(dimensions['height'])
def getposition(dimensions, attrib):    """    dimensions is an x, y two tuple.
    attrib is a dictionary.
    Returns x, y position of svg graphic as a    two tuple.    """    # Add 4.    x = attrib['X'] + dimensions[0]    # Add negative number with big absolute value.    # Upper right quadrant translation thing.    y = attrib['Y'] + dimensions[1]     return x, y
def getdimensions(attrib, biggerdimension, dimensionratio):    """    Get width and height of svg within    final document.
    attrib is the dictionary of numeric values    associated with the original image    position of the png within the    svg document.
    biggerdimension is the 'X' or 'Y' value that    indicates which dimension is the larger of    the two.
    dimensionratio is the ratio of the larger    dimension to the smaller one.
    Returns x, y two tuple of floats.    """    if biggerdimension == 'Y':        return (attrib['width'],  dimensionratio * attrib['width'])    else:        return (dimensionratio * attrib['height'], attrib['height'])
def getdimensionsorig(root):    """    root is the ElementTree Element    for the svg Element to be embedded     in the main svg file.
    Returns two tuple of width, height.    """    return float(root.attrib['width']), float(root.attrib['height'])

# OUTPUT (stdout)

Getting Hamilton logo svg file root Element . . .Getting company logo svg file root Element . . .Getting root Element of main graph svg file . . .Getting dimensions and viewBox for main graph svg file . . .Getting ElementTree indices for tree for Hamilton png logo Element . . .Getting ElementTree indices for tree for png Element . . .Getting ElementTree indices for tree for company png logo Element . . .Getting ElementTree indices for tree for png Element . . .Getting attrib dictionary for original Hamilton png file Element in graph svg . . .Getting attrib dictionary for original company png file Element in graph svg . . .Getting svg text values into float format for Hamilton png Element . . .Getting svg text values into float format for company logo png Element . . .Determining bigger dimension for svg Hamilton logo . . .Calculating dimensions ratio for Hamilton logo svg . . .Getting position of Hamilton logo . . .Getting size of Hamilton logo in final doc . . .Retrieving dimensions of Hamilton logo svg . . .Determining bigger dimension for svg company logo . . .Calculating dimensions ratio for company logo svg . . .Getting position of company logo . . .Getting size of company logo in final doc . . .Retrieving dimensions of company logo svg . . .Making changes to svg . . .Popping original Hamilton png logo . . .Appending Hamilton svg to root Element . . .Adjusting viewBox for Hamilton svg . . .Adjusting height and width for Hamilton svg . . .Positioning Hamilton logo svg within final svg . . .Erasing Hamilton logo bounding box . . .Popping original company png logo . . .Adding company logo svg Element to main svg file . . .Adjusting viewBox for company svg . . .Adjusting height and width for company svg . . .Moving company logo svg to the correct position in the display . . .Erasing company logo bounding box . . .Writing new svg . . .
doc_attrib =
{'height': '825pt', 'viewBox': '0.00 0.00 936.00 824.60', 'width': '936pt'}
hamilton_logo_tree_indices =
(0, 4, 2)
company_logo_tree_indices =
(0, 5, 2)
hamilton_logo_png_attrib =
{'height': '43.2px', 'preserveAspectRatio': 'xMinYMin meet', 'width': '43.2px', 'x': '218.3', 'y': '-673.9', '{http://www.w3.org/1999/xlink}href': 'hamiltonlogolarge.png'}
parsed_hamiltonlogo_png_attrib =
{'X': 218.3, 'Y': -673.9, 'height': 43.2, 'width': 43.2}
company_logo_png_attrib =
{'height': '43.2px', 'preserveAspectRatio': 'xMinYMin meet', 'width': '367.2px', 'x': '279.3', 'y': '-673.9', '{http://www.w3.org/1999/xlink}href': 'fauxcompanylogo.png'}
parsed_companylogo_png_attrib =
{'X': 279.3, 'Y': -673.9, 'height': 43.2, 'width': 367.2}
biggerdimension =
'X'
dimensionratio =
1.0421153385977506
parsed_graph_dimensions =
(4.0, 820.6)
hamilton_logo_position =
(222.3, 146.70000000000005)
hamilton_svg_dimensions =
(45.01938262742283, 43.2)
hamilton_logo_dimensions_orig =
(8710.0, 8358.0)
dimensionratio_company =
9.047619047619047
company_logo_position =
(283.3, 146.70000000000005)
company_svg_dimensions =
(390.8571428571429, 43.2)
company_logo_dimensions_orig =
(712.5, 78.75)
final_svg_file =
'data_source_highlighted_final.svg'

# . . . etc. 2 more times.

Note on DAG Hamilton: my use case for this tool is very rudimentary and somewhat pedestrian. That said, it is becoming essential to my workflows.

The DAG Hamilton project is still at its relatively early stages with some very exciting active development ongoing. It seems like every week some amazing new decorator feature gets released.

I am not much of one for decorators use - grateful for their existence and use in the 3rd party modules I use. Truthfully, 3/4 of the work I do could probably be accomplished with a relatively recent version of Python and dictionaries.

Where DAG Hamilton helps me out a lot is in corralling and organizing code. I tend to get a bit undisciplined and have trouble "seeing" the execution path. DAG Hamilton helps there.

Thanks for stopping by.

Planing A Self Organized Solo Trip

You know the movie Queen?

The actor Kangana Ranaut plays in that movie the role of Rani Mehra, a 24-year-old Punjabi woman, who was a simple, homely girl that was always reliant on her family. Similar to Rani I too rarely ventured out without my parents and often needed my younger sibling by my side. Inspired by her transformation, I decided it was time to take control of my own story and discover who I truly am.

Trip Requirements My First Passport

The journey began with a significant first step: Obtaining my first passport❗️ Never having had one before, I scheduled the nearest available interview date on June 29 2022. This meant traveling to Solapur, a city 309 km from my hometown, accompanied by my father. After successfully completing the interview, I received my passport on July 14 2022.

Select A Country, Booking Flights And Accommodation

Excited and ready to embark on my adventure, I planed trip to Albania 🇦🇱 and booked the flight tickets. Why? I had heard from friends that it was a beautiful European country with beaches and other attractions, and importantly, it didn’t require a visa for Indian citizens and was more affordable than other European destinations. Before heading to Albania, I planned a overnight stop in Abu Dhabi with a transit visa, thanks to friend who knew the process for obtaining it.

Some of my friends did travel also to Europe at the same time and quite close to my plannings, but that I realized just later the trip. 😉

Day 1, Starting The Experience

On July 20, 2022, I started my journey by traveling from Pune, Maharashtra, to Delhi, where my brother lives. He came to see me off at the airport, adding a touch of warmth and support to the beginning of my solo adventure. Upon arriving in Delhi, with my next flight scheduled for July 21, I stayed at a backpacker hostel named Zostel, Paharganj, Delhi to rest.

During my stay, I noticed that many travelers at the hostel carried rucksacks, which sparked a desire in me to get one for my own trip to Europe. Up until then, I had always shopped with my mom and had never bought anything on my own. Inspired by the travelers, I set out to find a suitable rucksack. I traveled alone by metro from Paharganj to Rohini to visit a Decathlon store, where I purchased a 50-liter rucksack. This was a significant step in preparing for my European adventure and marked a milestone in my journey of self reliance.

Day 2, Flying To Abu Dhabi

The following day, July 21 2024, I had a flight to Abu Dhabi. I spent the night at the hostel to rest before my journey. On the day of the flight, I needed to reach the airport by 3 PM, and a friend kindly came to drop me off. With my rucksack packed and excitement building, I was ready for the next leg of my adventure.

When we arrived at the airport, my friend saw me off, marking the start of my international journey. With mom made spices, chutneys, and chilly flakes packed for comfort, I completed my immigration process in about two and a half hours. I then settled at the gate for my flight, feeling a mix of excitement and anxiety as thoughts raced through my mind.

To ease my nerves, I struck up a conversation with a man seated nearby who was also traveling to Abu Dhabi for work. He provided helpful information about safety and transportation in Abu Dhabi, which reassured me. With the boarding process complete and my anxiety somewhat eased. I found my window seat on the flight and settled in, excited for the journey ahead. Next to me was a young man from Ranchi(Zarkhand, India), heading to Abu Dhabi for work at a mining factory. We had an engaging conversation about work culture in Abu Dhabi and recruitment from India.

Upon arriving in Abu Dhabi, I completed my transit, collected my luggage, and began finding my way to the hotel Premier Inn AbuDhabi, which was in the airport area. To my surprise, I ran into the same man from the flight, now in a cab. He kindly offered to drop me at my hotel, which I gladly accepted since navigating an unfamiliar city with a short acquaintance felt safer.

At the hotel gate, he asked if I had local currency (Dirhams) for payment, as sometimes online transactions can fail. That hadn’t crossed my mind, and I realized I might be left stranded if a transaction failed. Recognizing his help as a godsend, I asked if he could lend me some Dirhams, promising to transfer the amount later. He kindly assured me to pay him back once I reached the hotel room. With that relief, I checked into the hotel, feeling deeply grateful for the unexpected assistance and transferred the money to him after getting to my room.

Day 3, Flying And Arrive In Tirana

Once in the hotel room, I found it hard to sleep, anxious about waking up on time for my flight. I set an alarm to wake up early, but my subconscious mind kept me alert, and I woke up before the alarm went off. I got freshened up and went down for breakfast, where I found some vegetarian options like Idli-Sambar and bread with butter, along with some morning tea. After breakfast, I headed back to the airport, ready to catch my flight to my final destination: Tirana, Albania.

I reached Tirana, Albania after a six hours flight, feeling exhausted and I was suffering from a headache. The air pressure had blocked my ears, and jet lag added to my fatigue. After collecting my checked luggage, I headed to the first ATM machine at the airport. Struggling to insert my card, I asked a nearby gentleman for help. He tried his best, but my card got stuck inside the machine. Panic 🥵 set in as I worried about how I would survive without money. Taking a deep breath, I found an airport employee and explained the situation. The gentleman stayed with me, offering support and repeatedly apologizing for his mistake. However, it wasn’t his fault, the ATM was out of order, which I hadn’t noticed. My focus was solely on retrieving my ATM card. The airport employee worked diligently, using a hairpin to carefully extract my card. Finally, the card was freed, and I felt an immense sense of relief, grateful for the help of these kind strangers. I used another ATM, successfully withdrew money, and then went to an airport mobile SIM shop to buy a new SIM card for local internet and connectivity.

Day 4, Arriving In Tirana, Facing Challenges In A Foreign Country

I had booked a stay at a backpacker hostel near the city center of Tirana. After sorting out the ATM and SIM card issues, I searched for a bus or any transport to get there. It was quite late, around 8:30 PM, and being in a new city, I was in a hurry. I saw a bus nearly leaving the airport, stopped it, and asked if it went to the city center. They gave me the green flag, so I boarded the airport service bus and reached the city center.

Feeling very tired, I discovered that the hostel was about an hour and a half away by walking. Deciding to take a cab, I faced a challenge as the driver couldn’t understand my English or accent. Using a mobile translator to convert my address from English to Albanian, I finally communicated my destination to him. With that sorted out, I headed to the Blue Door Backpacker Hostel and arrived around 9 PM, relieved to have finally reached my destination and I checked in.

I found my top bunk bed, only to realize I had booked a mixed-gender dormitory. This detail had completely escaped my notice during the booking process. I felt unsure about how to handle the situation. Coincidentally, my experience mirrored what Kangana faced in the movie “Queen”.

Feeling acidic due to an empty stomach and the exhaustion of heavy traveling, I wasn’t up to cooking in the hostel’s kitchen.

I asked the front desk about the nearest restaurant. It was nearly 9:30 PM, and the streets were deserted. To avoid any mishaps like in the movie “Queen,” I kept my passport securely locked in my bag, ensuring it wouldn’t be a victim of theft.

Venturing out for dinner, I felt uneasy on the quiet streets. I eventually found a restaurant recommended by the hostel, but the menu was almost entirely non-vegetarian. I struggled to ask about vegetarian options and was uncertain if any dishes contained eggs, as some people consider eggs to be vegetarian. Feeling frustrated and unsure, I left the restaurant without eating.

I noticed a nearby grocery store that was about to close and managed to get a few extra minutes to shop. I bought some snacks, wafers, milk, and tea bags (though I couldn’t find tea powder to make Indian-style tea). Returning to the hostel, I made do with wafers, cookies, and milk for dinner. That day was incredibly tough for me, I filled with exhaustion and struggle in a new country, I was on the verge of tears 🥹.

I made a video call home before sleeping on the top bunk bed. It was a new experience for me, sharing a room with both unknown men and women. I kept my passport safe inside my purse and under my pillow while sleeping, staying very conscious about its security.

Day 5, Exploring Nearby Places

I woke up the next day at noon. After having some coffee, the hostel management girl asked if I wanted breakfast. She offered curd with cornflakes, which I refused because I don’t like curd. Instead, I ordered a pizza from a vegetarian pizza place with her help, and I started feeling better.

I met some people in the hostel, some from Syria and others from Italy. I struggled to understand their accents but kept pushing myself to get involved in their discussions. Despite the challenges, I felt more at ease and was slowly adapting to my new environment.

I went out from the hostel in the evening to buy some vegetables to cook something. I searched for shops and found some potatoes, tomatoes, and rice. I decided to cook Khichdi, an Indian dish made with rice, and added some chili flakes I brought from home. After preparing my dinner, I ate and then went to sleep again.

Day 6, Tiranas Recent History

The next day, I planned to explore the city and visited Bunkart-1, a fascinating museum in a massive underground bunker from the communist era. Originally built as a shelter for Albania’s political and military elite, it now offers a unique glimpse into the country’s history under Enver Hoxha’s oppressive regime. The museum’s exhibits include historical artifacts, photographs, and multimedia displays that detail the lives of Albanians during that time. Walking through the dimly lit corridors, I felt the weight of history and gained a deeper understanding of Albania’s past.

Day 7-8, Meeting Friends From India

The next day, I accidentally met with Chirag, who was returning from the Debian Conference 2022 held in Prizren, Kosovo, and staying at the same hostel. When I encountered him, he was talking on the phone, and I recognized he was Indian by his accent. I introduced myself, and we discovered we had some mutual friends.

Chirag told me that our common friend, Raju, was also coming to stay at the hostel the next day. This news made me feel relaxed and happy to have known people around. When Raju arrived, the three of us, Chirag, Raju, and I planned to have dinner at an Indian restaurant and explore Tirana city. I had a great time talking and enjoying their company.

Day 9-10, Meeting More Friends

Raju had a ticket to leave soon, so Chirag and I made a plan to visit Shkodër and the nearby Komani Lake for kayaking. We started our journey early in the morning by bus and reached Shkodër. There, we met new friends from the conference, Pavit and Abraham, who were already there. We had dinner together and enjoyed an ice cream treat from Chirag.

Day 12, Kayaking And Say Good Bye To Friends

The next day, Pavit and Abraham had a flight back to India, so Chirag and I went to Komani Lake. We had an adventurous time kayaking, even though neither of us knew how to swim. We took a ferry through the backwaters to the island on Komani Lake and enjoyed a fantastic adventure together. After our trip, Chirag returned to Tirana for his flight back to India, leaving me to continue my journey alone.

There should have been a video here but your browser does not seem to support it.

Day 13, Climbing Rozafa Castel

By stopping at Shkodër, I visited Rozafa Castle. Despite the language barrier, as most locals only spoke Albanian, people around me guided me correctly on how to get there. At times, I used applications like Google Translate to communicate. To read signs or hotel menus, I used Google Photos' language converter. I even used the audio converter to understand and speak some basic Albanian phrases.

I took a bus from Shkodër to the southern part of Albania, heading to Sarandë. The journey lasted about five to six hours, and I had booked a stay at Mona’s Hostel. Upon arrival, I met Eliza from America, and we went together to Ksamil Beach, spending a wonderful day there.

Day 14, Vlora Beach: Beach Side Cycling

Next, I traveled to Vlorë, where I stayed for one day. During my time there, I enjoyed beach side cycling with a cycle provided by the hostel owner and spent some time feeding fish. I also met a fellow traveler from Delhi who had brought along some preserved Indian curry. He kindly shared it with me, which was a welcome change after nearly 15 days without authentic Indian cuisine, except for what I had cooked myself in various hostels.

Day 15-16 Visiting Durress, Travelling Back To Tirana

I then visited Durrës, exploring its beautiful beaches, before heading back to Tirana one day before my flight home. On the day of my flight, my alarm didn’t go off, and I woke up late at the hostel. In a frantic rush, I packed everything in just five minutes and dashed toward the city center to catch the bus to the airport. If I had been just five minutes later, I would have missed the bus. Thankfully, I managed to stop it just in time and began my journey back home, reflecting on the incredible adventure I had experienced.

Fortunately, I wasn’t late; I arrived at the airport just in time. After clearing immigration, I boarded my flight, which had a layover in Warsaw, Poland. The journey from Tirana to Warsaw took about two and a half hours, followed by a seven to eight-hour flight from Poland back to India. Once I arrived in Delhi, I returned to Zostel and booked a train ticket to Aurangabad for the next three days.

Backview 😄

This trip was an incredible adventure for me. I never imagined I could accomplish something like this, but I did. Meeting diverse people, experiencing different cultures, and learning so much made this journey truly unforgettable.

Looking back, I realize how much I’ve grown from this experience. Although I may have more opportunities to travel abroad in the future, this trip will always hold a special place in my heart. The memories I made and the incredible people I met along the way are irreplaceable.

This experience goes beyond what I can express through this blog or words; it was incredibly precious to me. Every moment of this journey is etched in my memory, and I am grateful for every part of it.

Authored by Nadiia Nykolaichuk.

I care about performance, and I care about benchmarking. So it really annoys me when people throw out stuff like “this is 0.3% faster so it's a win”, without saying anything about the uncertainty in their benchmark estimates.

Turns out this is actually a fairly hard problem; since performance is essentially sum(before) / sum(after) and dividing anything by anything is rarely well-behaved in statistics. So the best I see is usually something like “worst and best we've seen”, which isn't… all that useful?

So at work, I coded up an implementation of the statistical bootstrap, based on some R code I've used for a while. It gives reasonable 95% and 99% confidence intervals of unpaired data, without relying on assumptions of normality (including via the central limit theorem); here's a set of benchmarks I ran recently over an optimization, as an example:

bigscreen:~/chromium/src> ./out/Default/pinpoint_ci ~/1047b79fc10000.csv Canvas Arcs [ -0.1%, +0.9%] Canvas Lines [ -0.6%, +0.4%] 👎 Design [ -1.5%, -0.2%] Images [ -1.3%, +0.8%] 👍 Leaves [ +0.6%, +1.3%] 👍 Multiply [ +0.7%, +1.3%] Paths [ -0.2%, +0.5%] 👍 Suits [ +1.4%, +3.2%] 👍 motionmark_ramp_composite [ +0.2%, +0.7%]

The program itself is geared towards interpreting a Chromium-specific output format (it is not a test runner), but the actual statistics code is encapsulated in a class with no other dependencies than a PRNG, a simple sorter and a math library, so it should be simple to port to other languages and environments. Like the rest of Chromium, it is liberally licensed.

You can find the code here. Happy benchmarking!

Hi everyone,

Growth as a software engineer is an ongoing journey. Looking back, a few key principles helped me progress during the early days of my career. These lessons shaped my path, and many of them continue to guide me today, even though I’m no longer an individual contributor:

1. Drive

   Ambition isn’t a skill — it’s a will. You either have it or you don’t. To grow, you need that inner drive pushing you forward. Sometimes it’s a conscious choice, and other times, you just can’t help it — something inside you refuses to stand still, driving you to keep learning and moving forward. I remember diving into Python and CI/CD back in the day, teaching it even when I was still learning myself.

2. Delivering results

   You might have gaps in your technical or soft skills, but if you consistently deliver, that goes a long way.  I always gave extra effort (probably leaning a bit on the workaholic side), especially on projects that excited me. Delivering results also helps you build your reputation and credibility — a win-win.

3. Choosing the right projects

   Whenever possible, work on projects that have the highest impact for the company and that interest you personally. There are two benefits: high impact projects give you the visibility and future opportunities you need, and personal interest helps you push forward when the going gets tough, and the going will get tough at some point — pretty much guaranteed.

4. Craft

   Delivering high impact with speed and quality requires deep expertise in your field. Which, in turn, requires understanding what’s going on under the hood. Expanding the breadth of your knowledge while diving deep into specific technologies (the so-called T-shaped expertise) served me well.

5. Teaching

   Teaching is a great way to solidify your knowledge and identify gaps in your understanding. Teaching also boosts your visibility and can establish you as a go-to person. Sharing what you know helps others and also helps you deepen your understanding. Personally, I view well-done code reviews as a form of teaching too.

6. Tolerance for conflict

   Criticism comes with the territory. Sometimes it’s called feedback, and other times it’s just plain criticism. I took many classes at the University of Hard Knocks on this one: I missed deadlines, over-engineered technical solutions, cut corners, and delivered feedback in a less-than-perfect way at that stage of my career. My advice: start building a thick skin sooner, but be smart about it. Know when to stand your ground and when to let things slide. Above all, don’t be a jerk.

7. Learning how business works

   This one’s underrated, and it took me a long, long time to learn. I wish I’d figured it out sooner, but better late than never.  While you can succeed at a certain level without focusing on this, understanding how the business works helps you identify high-impact projects and stand out as a valued partner — not just another tech person from a cost center.

As the saying goes, “The only way to do great work is to love what you do.” I’d add — love the challenges, love the process, and love the growth that comes with them.

Stay curious,

Ruslan

This week started with undoing the horrors that y’all were subjected to last week: TwoTerribleTextAreasWidget featured prominently. The follow-up that I mentioned landed (Ben “bnjmnm” Mullins and I collaborated on it), which with a +110,-245 diff resulted in something that still is nowhere near a final UX, but is starting to look reasonable.

The evolved component instance props form: much simpler (it looked Frankensteinish a week ago!), by using the appropriate field widgets directly. Issue #3461422.

(Next up on that front: #3462310: Component props form: make form elements match design.)

That right sidebar is overlaid on top of the canvas, which also saw a big leap forward this week — thanks to Jesse “jessebaker” Baker, Harumi “hooroomoo” Jang, Ben “bnjmnm” Mullins and Lauri — a true team effort:

Component states in action: hover and active/focus. Issue #3460783, image by Jesse.

The images you saw last week showed actual component previews … but we cheated by using inline styles :P.
This week, Ben rectified that: CSS/JS assets are now loaded inside the preview <iframe>s.

But I saved the best for last: the last MR to land this week was Ben’s Redux integration issue … which brought with it: live updates of the component’s preview:

Live updating of component previews while the props are edited in the right sidebar! Issue #3462441, image by Ben.

This currently always requires a round trip to the server, but in many cases we’d actually be able to update the preview without a round trip (better for UX obviously!). See #3453690: [META] Real-time preview: supporting back-end infrastructure, where Lee “larowlan” Rowlands intends to work on parsing a Single-Directory Component’s Twig template into an Abstract syntax tree, which would allow eliminating that round trip in typical cases.1

I omitted less interesting MRs, but there’s one more issue that landed that deserves a mention: Ted “tedbow” Bowman and Ben landed CI: use a snapshot of core’s phpcs rules as changes in Drupal core will break MRs with limited benefit to module development, which was a very welcome addition: recently, Drupal 11 development has picked up steam … and hence several coding standards were added to Drupal core. Result: XBs phpcs CI job started failing overnight, with zero changes on our end. Doing the right thing can be painful! So, Ted and Ben changed that so we’d be notified instead: far less disruptive.

In progress/where to contribute

• Experience Builder has some needs that Single-Directory Components has not had to fulfill. Lauri asked me to start developing a comprehensive plan for integrating XB with SDC: what are all the mismatches, the feature gaps, et cetera?
• Ted discovered that XB currently does not support propless SDCs — oops! This is a great first issue to contribute to XB!
• Lauri created #3463300: Implement the concept of sections within the client
• Lauri also created #3463307: Implement simplified zoom interface, which Gauravvvv quickly picked up!
• Ben created #3463610: VH units fix only works for inline styles, which seems another great first issue to contribute to XB, but this time on the front end.
• Finally, I created #3463957: “Publish” and “Share” buttons should convey they do not yet work, which was quickly picked up by fazilitehreem :)

P.S.: issues that were picked up by somebody do not exclude you from contributing too — as you can see above, almost every issue is a multi-person effort!

Missed a prior week? See all posts tagged Experience Builder.

Goal: make it possible to follow high-level progress by reading ~5 minutes/week. I hope this empowers more people to contribute when their unique skills can best be put to use!

For more detail, join the #experience-builder Slack channel. Check out the pinned items at the top!

Week 11 was July 22–28, 2024.

1. If the SDC prop value is rendered as-is, with no transformations applied, then no round trip is necessary. Otherwise, that might be needed. ↩︎

• Drupal
• Acquia
• Experience Builder

• Component states in action: hover and active/focus.
• The evolved component instance props form: much simpler, by using the appropriate field widgets directly.
• Live updating of component previews while the props are edited in the right sidebar!

The Drop Times will host a stall at Drupal GovCon 2024 from August 13th to 15th. Stop by to discuss Drupal’s impact on public sector digital transformation and explore its future potential.

Version 2.4 of GNU Rush is available for download.

New in this release:

• Use getgrouplist(3) call, if available;
• Fixes in the rush-po script;
• Bugfixes

Let’s go for my web review for the week 2024-32.

A New Type of Neural Network Is More Interpretable - IEEE Spectrum

Tags: tech, ai, machine-learning, neural-networks, physics

Exciting new type of neural networks. There are limits to use them at large scale for now. Still, they have very interesting properties like the interpretability. And also, they tend to give similar performance to traditional neural networks for a smaller size.

https://spectrum.ieee.org/kan-neural-network

What do people really ask chatbots? It’s a lot of sex and homework

Tags: tech, ai, gpt

If you’re wondering what people do with chat bots, there are some clues here.

https://www.washingtonpost.com/technology/2024/08/04/chatgpt-use-real-ai-chatbot-conversations/

Judge rules that Google ‘is a monopolist’ in US antitrust case - The Verge

Tags: tech, monopoly, law

Looks like the US Department of Justice is back pushing for antitrust trials. This is likely a good thing, will it go all the way to breaking down some of the big tech companies? I doubt it but it’d probably be welcome.

https://www.theverge.com/2024/8/5/24155520/judge-rules-on-us-doj-v-google-antitrust-search-suit

Google Search speculation

Tags: tech, google, mozilla, law

Interesting guesses at what could change with the Google ruling. It doesn’t look too good for Mozilla.

https://micro.webology.dev/2024/08/06/google-search-speculation.html

Y’all are sleeping on HTTP/3

Tags: tech, quic, http, networking

Clearly there’s a silent transition going on. It’s not necessarily bad that it’s on-going without making too much noise.

https://kmcd.dev/posts/yall-are-sleeping-on-http3/

How to Get or Create in PostgreSQL

Tags: tech, databases, postgresql

Definitely not as simple as it sounds. The devil is once again in the details.

https://hakibenita.com/postgresql-get-or-create

Go debug your core dumps somewhere else

Tags: tech, debugging

You need to understand how core dumps work? This article is for you.

https://trace.yshui.dev/2024-08-copy-core-dumps.html

Code auditing productivity multiplier.

Tags: tech, c++, tools

Looks like an interesting tool for indexing and querying C++ code.

https://github.com/trailofbits/multiplier?tab=readme-ov-file

The difference between undefined behavior and ill-formed C++ programs

Tags: tech, programming, c++, safety

This is a very important distinction to keep in mind. It’s one of those source of bad mistakes in C++.

https://devblogs.microsoft.com/oldnewthing/20240802-00/?p=110091

Enum class improvements for C++17, C++20 and C++23

Tags: tech, c++

Enum classes keep being improved. Nice features are already available, more might be coming through reflection in C++26.

https://www.cppstories.com/2024/enum-improvements/

[JDK-8303099] Null-Restricted and Nullable Types (Preview) - Java Bug System

Tags: tech, programming, java, safety

This would definitely be a nice change to the Java language.

https://bugs.openjdk.org/browse/JDK-8303099

What the heck are reverse mapped types?

Tags: tech, typescript, type-systems

The TypeScript type system is really a beast. There are little known features in this, looks definitely like one of them.

https://andreasimonecosta.dev/posts/what-the-heck-are-reverse-mapped-types/

Reliable JavaScript benchmarking with Tachometer

Tags: tech, javascript, benchmarking, tools

Looks like a nice tool for benchmarking Javascript in the browser.

https://nolanlawson.com/2024/08/05/reliable-javascript-benchmarking-with-tachometer/

GM Shaders Guest: Radiance Cascades

Tags: tech, 3d, shader

Very neat technique for global illumination. Very effective but still has some issues.

https://mini.gmshaders.com/p/radiance-cascades

Store Code Discussions in Git using Git Notes

Tags: tech, tools, git, version-control, codereview

I like the idea of getting all the review comments back into Git once things are merged. This works offline, makes you less dependent on the forge for historical data etc. Now we’d probably need to have the notes feature easier to use somehow.

https://wouterj.nl/2024/08/git-notes

Build metrics and budgets with git-metrics

Tags: tech, tools, git, version-control, quality

Maybe we could store metrics about the code in the history as well? This would indeed reduce vendor lock-in. This tool makes it easy. Unsurprisingly seems built upon git notes.

https://dev.to/jdrouet/build-metrics-and-budgets-with-git-metrics-4pb4

Humans >> Data - by Kent Beck

Tags: tech, engineering, productivity, metrics

Aren’t we loosing something if we focus on productivity numbers too much? A good reminder that intrinsic motivation is an important driver in people behavior. I wouldn’t throw all the metrics out of the door but they’d better be a limited amount and they’d better be informative rather than objectives.

https://tidyfirst.substack.com/p/humans-data

Bye for now!

What hurdles must be cleared when starting an international organization? How do you empower others in a community by sharing responsibilities? This week on the show, we speak with Jay Miller about Black Python Devs.

[ Improve Your Python With 🐍 Python Tricks 💌 – Get a short & sweet Python Trick delivered to your inbox every couple of days. >> Click here to learn more and see examples ]

Dominique De Cooman shares his plans to position Drupal as a leader in the open Digital Experience Platform (DXP) ecosystem as the Drupal Association&#039;s board election approaches. In this interview, he outlines his strategy for expanding Drupal’s influence in the midmarket and fostering innovation through stronger connections with other open-source platforms. Read on to discover how Dominique aims to help shape Drupal&#039;s future.

Here's what I've been working on for my Drupal contributions this week. Thanks to Code Enigma for sponsoring the time to work on these.

Conda-forge has kindly been providing support for PyPy since 2019. The conda-forge team has been very patient and generous with resources, but it seems the uptake of PyPy has not justified the effort. Major packages still are not available on PyPy, others find it hard to update versions. We don't get much feedback at all about people using PyPy, and even less about PyPy on conda-forge. The conda-forge team has proposed sunsetting PyPy going forward, which means current packages would remain but no new packages would be built. If you have an opinion, you can comment on that PR, or on this blog post.

Since conda-forge supports PyPy3.9 but not PyPy3.10, we have continued releasing PyPy3.9 even though we typically support only one version of PyPy3. With the sunsetting proposal, we will not release any more updates to PyPy3.9. I opened a poll about the intention to drop PyPy3.9. If you have an opinion, please chime in.

In this episode, we are taking a break from JourneyInbox and exploring what kind of Go app we can make by just using the Go standard library. This is the final continuation after an internet disconnection.

The diffoscope maintainers are pleased to announce the release of diffoscope version 274. This version includes the following changes:

[ Chris Lamb ] * Add support for IO::Compress::Zip >= 2.212. (Closes: #1078050) * Don't include debug output when calling dumppdf(1). * Append output from dumppdf(1) in more cases. (Closes: reproducible-builds/diffoscope#387) * Update copyright years. [ Mattia Rizzolo ] * Update the available architectures for test dependencies.

You find out more by visiting the project homepage.

Friday, 9 August 2024

KDE today announces the release of KDE Frameworks 6.5.0.

KDE Frameworks are 72 addon libraries to Qt which provide a wide variety of commonly needed functionality in mature, peer reviewed and well tested libraries with friendly licensing terms. For an introduction see the KDE Frameworks release announcement.

This release is part of a series of planned monthly releases making improvements available to developers in a quick and predictable manner.

New in this version Attica

• Support new version field on DownloadDescription. Commit.

Bluez Qt

• Manager: Fix connections for the connectedDevices list property. Commit.

Breeze Icons

• Add 22px color (and monochrome, using *-symbolic) category icons. Commit. Fixes bug #489347
• Make 16px list-remove-symbolic be a link to the base icon. Commit.
• Add symlinks for Crow Translate icons. Commit. Fixes bug #489984
• Add flatpak symlink for Git Cola. Commit.
• Add icon to indicate adding to a playlist immediately after the current track. Commit. See bug #429942

Extra CMake Modules

• Prefix.sh.cmake add MANPATH. Commit.
• FindWaylandScanner: Add flag to use private-code. Commit.

Framework Integration

• Plasma_workspace.notifyrc: relabel to match button. Commit.

KArchive

• Allow passing QIODevice::Truncate in open mode. Commit.

KAuth

• Allow the dbus backend to pass file descriptors as arguments. Commit.
• Ensure that qt dbus macros are available with KAUTH_BUILD_CODEGENERATOR_ONLY=ON. Commit.

KCMUtils

• AbstractKCM: Document what extraFooterTopPadding is for. Commit.
• AbstractKCM: remove false deprecation notice. Commit.

KCodecs

• Add static build support. Commit.

KColorScheme

• Bundle essential breeze color schemes as resource. Commit.

KConfig

• Ksharedconfig: move statercs to state dir. Commit.
• Explain what "desktop entry spec separator semantics" means. Commit.
• Reapply "don't create root-only readable files in /etc/xdg". Commit.
• Make Qt6Quick dependency for QML plugin private. Commit.
• Expose KWindowStateSaver in the QML interface. Commit.
• Sync config group on KWindowStateSaver::timerEvent. Commit.
• Don't do tests in ~/.kde-unit-test. Commit.

KCoreAddons

• Enable cppcheck. Commit.
• Add missing license header. Commit.
• Add QML Format example. Commit.
• [qml/formats] Drop no longer needed function. Commit.
• Remove obsolete doc comment. Commit.
• Replace deprecated globalMatch with globalMatchView. Commit.

KCrash

• Metadata: Include frameworks version number. Commit.
• Metadata: pass along qt version. Commit.
• Don't capture unused variable. Commit.
• Add CMakelint formatting commit to .git-blame-ignore-revs. Commit.
• ./CMakeLists.txt:26: Extra spaces between 'if' and its () [whitespace/extra]. Commit.

KDeclarative

• KeySequenceItem: be Accessible.Button, not Checkbox. Commit.
• KeySequenceItem: Use KMessageDialog for displaying conflict messages. Commit.
• Kquickcontrols: Drop validation code from KeySequenceHelper. Commit.
• Kquickcontrols: Use KeySequenceValidator in KeySequenceItem. Commit. Fixes bug #483199
• Kquickcontrols: Introduce private KeySequenceValidator type. Commit. See bug #483199

KFileMetaData

• [Extractors] Clarify Qt::Gui dependencies. Commit.

KGuiAddons

• Add missing license text. Commit.

KHolidays

• Kazakhstan: Add National Book Day. Commit.

KI18n

• Use more specific names for the functions. Commit.
• Add comment for translators in example code. Commit.
• Code cleanup. Commit.
• Minor Doxygen change. Commit.
• Build with older clang versions too. Commit.
• Test also retranslateFormatString. Commit.
• Make retranslateFormatString() call function from correct namespace and adjust code documentation. Commit.
• Add helper method for setting a plural-aware spin box prefix/suffix. Commit.

KIconThemes

• Fix icon recoloring for portable installers. Commit.
• Overhaul KIconEngine docs. Commit.
• Deprecate KIconLoader::drawOverlays. Commit.
• Deprecate movie loading API. Commit.
• Add back effect into cache key. Commit. Fixes bug #490795
• Deprecate KIconEffect::apply API. Commit.
• Refactor icon effect application. Commit.
• [kiconeffect] Add static API for active effect. Commit.
• [kiconeffect] Add static API for disabled effect. Commit.
• [kiconeffects] Drop color and color2 members. Commit.
• [kiconeffects] Don't read effect settings from kconfig. Commit.
• [kiconeffect] Replace raw numbers with relevant enum. Commit.
• Add note to prefer QIcon::fromTheme over KIconLoader. Commit.
• Remove edit-specific directives. Commit.

KImageformats

• JXL: added ImageTransformation option. Commit.
• Xcf: Fix crash on malformed files. Commit.
• Pcx: Fix crash in broken files. Commit.
• Xcf: Fix crash on broken files. Commit.
• Pcx: fix crash on invalid files. Commit.
• Pcx: fix crash on invalid files. Commit.
• Exr: added some usefull attributes. Commit.
• Pcx: Read 16 color images that are 4bpp and 1 plane. Commit.
• Full range HDR support. Commit.
• Prepare gitlab for files that are coming int the next commit. Commit.
• Avif: check return values. Commit.
• Raw: Fix compiler warning with macro redefinition in Windows. Commit.

KIO

• KFileWidget: reset preview to selected file on hover leave. Commit. See bug #418655
• Drop unused methods from ConnectionServer. Commit.
• Un-PIMPL ConnectionServer. Commit.
• Properly log errors in ConnectionServer::listenForRemote(). Commit.
• Beef up connection error logging. Commit.
• [kprocessrunner] Also request an XDG activation token with StartupNotify=false. Commit.
• Port from KIconLoader::drawOverlays to KIconUtils::addOverlays. Commit.
• Kdirmodel: fix case when first deleted item was hidden. Commit.
• Kfileitem: show relative path for rel symlink. Commit. Fixes bug #456198
• File_unix: extract readLinkToBuffer to fn. Commit.
• Kshellcompletion: remove unused variable. Commit.
• KFilePlacesView: Show free space info in the tooltip. Commit.
• KFilePlacesView: Show label in tooltip if it is elided. Commit. Fixes bug #454436
• KFilePlacesItem: Add tooltip. Commit.
• Ksamba: correct isAclValid regex. Commit.
• DeleteOrTrashJob: emitResult with ERR_USER_CANCELED when cancelling prompt. Commit.
• Alter permissions of the right file. Commit.
• Try to fix test if umask is not as expected. Commit.
• Enable one more test that works for me. Commit.
• Ensure the wanted one second diff. Commit.
• Make test more deterministic. Commit.
• Less pollution of the home with test tmp files. Commit.
• Port away from deprecated KIconEffect API. Commit.
• Kprocessrunner: small code improvements. Commit.
• Lookup QWidget parent at runtime. Commit.
• Remove unused includes. Commit.
• Drop SessionData. Commit.
• Move useragent handling code into HTTP worker. Commit.
• Remove unused member. Commit.
• Drop dead metadata. Commit.
• Cache KFileItem::isHidden result. Commit.
• Avoid reparsing mount points for each directory on destruction. Commit.
• Remove parent for DropMenu. Commit. Fixes bug #490183
• Systemdprocessrunner: escape $ in arguments. Commit.
• API dox: help doxygen to not auto-detect first sentence end after "i.e.". Commit.
• API dox: document CamelCase include for KFileFilter. Commit.

Kirigami

• Relicense MenuDialog and PromptDialog to LGPL. Commit.
• GlobalDrawerActionItem: Fix tooltip. Commit.
• ContextualHelpButton: make text always accessible. Commit.
• Convert license headers to SPDX. Commit.
• Port dialogs to pragma ComponentBehavior: Bound. Commit.
• Dialog: Support variable base padding. Commit.
• Dialog: Add some null safety. Commit.
• Dialog: Fix ScrollView::contentItem management. Commit.
• We can Use directly nullptr. Commit.
• Fix: install KirigamiPrivate soversion. Commit.
• NavigationTabButton: Drop bold font workaround. Commit.

KItemModels

• Fix incorrect QML element name in documentation. Commit.

KNewStuff

• Support new version field on DownloadLinkInformation. Commit.
• QML: Use some better property types. Commit.
• EntryDetails.qml: Qualify newStuffModel, use downloadItemId. Commit. Fixes bug #483659
• Use KPackageJob::update instead of ::install. Commit.

KNotifications

• Allow to build on oses without dbus and any other backend. Commit.

KParts

• Use the correct check to determine whether initial preference should be read from KParts or KPlugin. Commit.

KPeople

• Make locks actually lock. Commit.

KService

• Store canonicalFilePath instead of looking it up twice. Commit.
• Use canonicalFilePath instead of absoluteFilePath. Commit.
• Use absolute path to mimeapps.list. Commit.

KStatusNotifieritem

• Add API to control quit behavior. Commit.

KSVG

• FindInCache: Compare last modified to boot time if timestamp is 0. Commit. Fixes bug #453876
• Drop dead code. Commit.

KTextEditor

• Fix drag pixmap with wrapped lines. Commit. Fixes bug #476979
• Add actions to convert spaces to tabs and vice versa. Commit. Fixes bug #456736
• Use ktexteditor-script-tester6 for javascript tests. Commit.
• Fix -Woverflow warning with gcc. Commit.
• Templates: Remove one level of nesting. Commit.
• Ignore buffer signals in completion on undo/redo. Commit.
• CursorToOffset: remove unnecessary line variable. Commit.
• Fix formatting. Commit.
• Src/view/kateview.cpp (KTextEditor::ViewPrivate::setupActions) : Fix typo in m_toggleShowSpace and m_toggleDynWrap whatsThis text. Commit.
• Treat 0x0000 to 0x001F as non-printable. Commit.
• Add action to quick toggle space visibility. Commit.

KWidgetsAddons

• Fix that last line in fonts list is only half visible. Commit. Fixes bug #488079
• Avoid the creation of toplevel widget. Commit. Fixes bug #490712
• Remove unused license text. Commit.
• Partially revert cccaa8f89897146043a535d45a276e3a57412815. Commit.
• Deprecate KJobWidgets::setWindowHandle,windowHandle. Commit.
• Fix tab not highlighted in some cases. Commit.
• Fix multiple overlays being installed over tab. Commit. Fixes bug #490213

KXMLGUI

• Remove QTreeWidgetHack, the methods are public now. Commit.
• Fix compile error of krichtexteditor on Craft on Windows. Commit.

Network Manager Qt

• ConnectionSettings: Support MeCard SAE security type. Commit.

QQC2 Desktop Style

• ScrollBar: Fix custom scrolling behavior. Commit. Fixes bug #488092

Solid

• Udev/cpuinfo_arm: add M2 Pro/Max core variants. Commit.

Sonnet

• Downgrade qCWarning to qCDebug. Commit.
• Avoid initializing full HSpellDict when getting languages. Commit. Fixes bug #421451
• Fix SONNET_USE_QML=OFF by moving ECMQmlModule behind the conditional. Commit.

Syntax Highlighting

• Earthfile.xml: modernize highlighter to support Earthly 0.8 features. Commit.
• C++: add floating-point literal suffixes of C++23. Commit.
• Python: add some special variables and fix '' line continuation after a string. Commit.
• Add .clang-format and .clang-tidy files with YAML. Commit.
• Zig: fix range operator preceded by a number: [0..]. Commit.
• Odin: add raw string color. Commit.
• Update syntax highlighting for kdesrc-buildrc. Commit.
• Cmake.xml: update syntax for CMake 3.30. Commit.
• Inc version after done type adding. Commit.
• Hare: add done keyword. Commit.

Threadweaver

• Ensure windows tests work. Commit.
• Only enter loop if signal didn't arrive before that. Commit.
• Try to fix windows hang in tests. Commit.

Much like my last update things are going well. I am able to spend 2 full days every week on contribution and my commit activity has increased quite a lot. Many thanks to my sponsors: Palantir.net, OPTASY, and new ones who joined in the past few weeks: Vardot, OpenSense Labs, and Liip.ch.

Now some numbers, since the last update I committed 82 issues (worth 820 weighted issue credits), that’s about 33 issues per month (or 330 issue credits). That’s a few more issues per week than before. There is still room to increase the commit activity with more sponsors so don’t hesitate to check out how to sponsor my contribution in core.

1. Navigation LayoutBuilder UI has dead click zone
2. Update the Drupal logo in Drupal core with the 2024 brand evolution I like the new brand very much, it’s good to update the default icon
3. Update documentation for table.html.twig around table cells
4. Regression: The drawer in Safari is missing the drop shadow
5. Update the Drupal logo on the project page
6. Meeting notes: May 20th 2024 - Isomorphic rendering Meetings take time, I can now spend it more easily to keep updated and make sure everyone is aligned
7. Remove JavaScript from Views configuration form now that it is only CSS Removing JS code because CSS is so good now is always nice
8. Navigation overlay z-index is not defined
9. Update stylelint rule unit-allowed-list to include container query units
10. Navigation: Avoid layout builder form submit
11. Tab highlights for current/hover/click are too high up when other tabs have 2 lines of text
12. Mobile version of Navigation menu doesn’t properly reset Drupal.displace() on closing
13. core.libraries.yml mis-implements moved_files syntax
14. When configuring a field on a content type’s “manage display” tab the spinner shifts the label and format column
15. #states not working correctly when built from a logical combination of multliple fields
16. Responsive image width/height values are not used from fallback image style
17. Custom Navigation logo is disconnected from new Layout template
18. CKEditor 5 Styles dropdown broken when in off-canvas sidebar
19. [drupalMedia] Ability to mark image media as “decorative”
20. Refactor (if feasible) use of jquery parseHTML function to use vanillaJS removing jQuery one method at a time
21. drupalInstallModule nightwatch function does not work with Experimental modules
22. Prefer to use Array.prototype.includes() for some of Array.prototype.indexOf()
23. Claro: Autocomplete dropdown bleeds through sticky table header
24. Refactor Claro’s table–file-multiple-widget stylesheet
25. “Single-Directory Components” needs to be hyphenated because of English grammar and content style rules
26. Trigger a JavaScript deprecation error for dialogClass in forked dialog.js
27. Update to jquery UI 1.14.0 beta 2 Bleeding edge of web development :)
28. Implement Nightwatch tests for Navigation module
29. Visually-hidden refresh button in Field UI fails WCAG Focus Visible.
30. Olivero: Incorrect positioning of close button on mobile device when navigation module is enabled.
31. The core/drupal.message library requires a status_messages render element
32. The [0] hatch in misc/vertical-tabs.js causes issues if there are multiple forms with vertical tabs. One thing jQuery does well is handle uncertainty much better than vanilla JS, and removing jQuery exposes us to that kind of things
33. Drupal core committers team meeting - Dev Days Burgas 2024
34. Reorder checkboxes on “Development settings” page
35. Secondary tabs design is distorted on block view page
36. Drupal core committers meeting 2024-06-11
37. Remove decoupled menus and media initiatives from MAINTAINERS
38. Update Drupal’s default throbber icons Using svg instead of gifs, overdue
39. Update loading icon and use SVG
40. Layout shift on displays in views page
41. Remove documentation for readmore, logged_in and is_admin from node.html.twig
42. Remove legacy ‘metadata’ variable from node.html.twig
43. Prevent simultaneous open/close on simultaneous click/hover Navigation still needs polish, this one helped quite a bit with regular use
44. Long string breaks the layout of Claro (reapply fix)
45. Spacing issue in Home > Search page on Advanced search section
46. Autocomplete input text can visibly overflow under magnifier icon
47. Refactor Claro’s tabledrag stylesheet
48. Have a dedicated category for blocks provided by the Navigation module
49. ToolbarStoredStateTest needs wait after resizing window
50. The link on the Image tag is redirecting to an undefined page from the node preview screen
51. clarify db settings for run-tests.sh example command
52. Parameters doc for views “row” should be at the top level of the array
53. Consolidate Umami performance tests
54. Optimize TelephoneFieldTest
55. hook_local_tasks_alter() and hook_menu_local_tasks_alter() need mutual @see links
56. Update to ckeditor 42.0.2
57. Consolidate methods on FormElementsLabelsTest
58. Merge the build and lint stages in core MR pipelines Tests go faster
59. Fix Field UI tests that rely on UID1’s super user behavior
60. Single directory component CSS asset library not picked up in admin theme immediately after module install without cache clear
61. Replace t() calls inside of Controllers that do not use StringTranslationTrait
62. Render API overview should include a link to the list of elements
63. Resync .gitlab-ci.yml and .gitignore following Yarn 4 in 11.x
64. Merge test methods in FieldUIRouteTest for better performance
65. Fix File tests that rely on UID1’s super user behavior
66. Stop using a data provider in UserPasswordResetTest
67. More efficient route lookup caching
68. Update deprecation notices in ajax.js
69. Consolidate ckeditor5’s FunctionalJavascript tests More test speed
70. Drupal Displace outputs invalid value for --drupal-displace-offset-right when opening top dialog
71. Subpixel rounding issue causes dialog to resize unnecessarily That one had a funky side effect when resizing the browser window. It’s gone now :)
72. Document that Uuid::isValid() only considers lowercase UUIDs as valid
73. Menu system docs section gives wrong alter hook
74. standardize docs on how to use the 4 types of test base
75. Update to jQuery UI 1.14.0
76. Add example and sections to Block API documentation
77. FileSystemInterface::copy documentation is inaccurate
78. Use artifacts to share the eslint and styleint caches from core to MRs
79. New throbber SVG images lack xmlns attribute
80. Drupal core committers meeting 2024-08-05
81. Drupal core committers meeting 2024-07-01
82. Document the recommended ways to obtain the database connection object

There were too many to comment each one individually. Many issues on stabilizing the new navigation module, making core tests faster, and documentation.

If you’re interested in supporting my work on Drupal core and keep the frontend fixes coming, consider sponsoring me.

Only Seven Days to Submit Your Session! Published Date Thursday, August 8th, 2024 - 04:47 pm bcross Thu, 08/08/2024 - 16:47 Do It This Week! 

Twin Cities Drupal Camp 2024 kicks off on September 12th-13th, on the University of Minnesota Twin Cities campus. The deadline for Session Submission is only a week away on August 15th. You still have time to send in your session proposals to help create this event. 

We have received many great new sessions for Twin Cities Drupal Camp 2024. Read our the Blog post “Send Us Your Session” to find a sampler of accepted sessions and ideas from last year's camp.

Submitting Your Session is Easy 

Simply fill out the submission form with your session title, description, and any additional details you’d like to provide. 

Our session review team will go through all submissions in order to select a diverse and engaging lineup of sessions for Twin Cities Drupal Camp 2024. Sessions will be accepted on a rolling basis. This means you are more likely to get your session accepted if you send it in today! 

Submit a Session

Posted In Drupal Planet

It’s August! For many of us, that means it’s time for hot weather and perhaps even a vacation.

But if you’re a Python/Pandas nerd like me, it’s is the perfect time to level up your programming skills. And in the coming weeks, I’ll be offering 13 (!) live, online courses on a wide variety of Python and Pandas topics, including some I’ve never before taught online.

Here’s what you can expect in all of these courses:

• In-depth explanations that go beyond the syntax
• Examples, including practical connections to real-world problems
• Exercises that help you to solidify the ideas I’ve taught
• Live coding into Jupyter, rather than teaching with slides
• Plenty of time for you to ask questions
• Lots of dad jokes

All of the classes will be recorded, so if you cannot make them at the official time, you can always watch later. I’ll also provide the Jupyter notebook and any other files I used, so that you can replay the lesson at home.

Here’s what I’ve scheduled so far; I expect to release more dates and topics in the coming weeks:

• Wednesday, August 14th: Data cleaning in Pandas
• Wednesday, August 14th: Complex Pandas queries with method chaining
• Thursday, August 15th: Design patterns in Python
• Sunday, August 18th: Python decorators
• Monday, August 19th: Textual data in Pandas
• Monday, August 19th: CSV files in Pandas
• Tuesday, August 20th: Command-line tools in Python
• Wednesday, August 21st: Grouping and pivot tables in Pandas
• Sunday, August 25th: Polars
• Monday, August 26th: Scraping with BeautifulSoup and Scrapy
• Tuesday, August 27th: Intro to FastAPI
• Sunday, September 1st: Intro to machine learning with sklearn
• Tuesday, September 3rd: asyncio

You can, of course, buy these courses individually. But they’re included in my membership programs, via LernerPython.com. The Python and Web courses are available to all members, while the Pandas and machine-learning courses are available to people who join my Python+Data membership level.

Which means: If you join me at LernerPython.com, then you get access to these courses, plus my entire catalog, plus a forum for discussion and questions, plus office hours where you can ask any questions you have. If you get a Python+Data membership, then you’ll get Bamboo Weekly, as well, with weekly Pandas challenges based on current events.

Note that my normal discounts for students, retirees/pensioners, and people in non-rich countries all apply; e-mail me at reuven@lerner.co.il if you qualify for any of these.

I’m super excited to be offering these courses, and will be back in a few weeks with even more offerings.

Meanwhile, I’m always happy to hear your questions and thoughts at reuven@lerner.co.il. All messages go straight to my personal inbox!

The post Level up your Python skills this August appeared first on Reuven Lerner.

A few weeks ago, we introduced the concept of "tracks" as the next step in progressing the Drupal Starshot project. Tracks are smaller, focused parts of the project that allow for targeted development and contributions.

At the same time, we put out a call for Starshot track leads, and were overwhelmed by the response. We received nearly 65 submissions, showcasing a wide range of expertise and ambitious vision that made for a difficult review process.

Announcing new track leads

We are proud to announce the newest track leads, who bring to the Starshot team an impressive depth of experience both in Drupal and in their respective track space:

• Laurens Van Damme from Dropsolid will be leading the Blog recipe track
• Jürgen Haas from LakeDrops will lead the Privacy track
• Christian López Espínola and Matthew Tift from Lullabot will lead the Dashboard track
• Jim Birch from Kanopi and John Doyle from Digital Polygon will lead the Sitewide SEO recipe track
• Jamie Abrahams from FreelyGive will lead the AI track
• Tony Barker from Annertech will lead the Media management track
• Baddy Sonja and the team at 1xinternet will lead the Advanced search track
• Gareth Alexander from Zoocha will lead the Accessibility tools track
• Dharizza Espinach and the team at Evolving Web will lead the Analytics track
• Pavlos Daniel from Acquia will lead the Multilingual content track

Although we announced the concurrent editing track, this is an aspirational feature that we would love to see but have postponed because it will depend heavily on Experience Builder.

Further opportunities with tracks

If you've read the Starshot strategy that Dries shared, you may have noticed that there are capabilities listed that do not yet have a track. We will be creating more tracks ongoing, to align with this strategy as the need arises (and as our capacity allows!).

There are also three existing tracks that we have not yet assigned a lead:

• Starshot documentation
• Contact form
• Content publishing workflows

If you are interested in leading one of these, make sure to review the issues for information about what we are aiming for, as well as the track lead role description. Your vision for the track, which need only be a short summary of how you plan to approach it, should take these into account when you submit an application. 

Next steps for tracks

For most tracks, the initial work will be to put together a proposal, which may require research to define the key requirements for our target persona and determine what feature parity with market leaders looks like. The proposals will be shared with the community for consultation.

We also expect track leads to provide regular progress updates, with the format and frequency still to be determined.

If you want to contribute to one of the tracks, or just follow along, keep an eye on the meta issues in the Starshot queue or post a comment to put your hand up.