Skip to main content

How to connect to CSV files using Ruby DBI ODBC and no DSN

I had a hard time finding a way of connecting to csv files using ruby's dbi through the odbc driver without using a DSN. The odbc turned not to work with Microsoft Text driver for odbc because the name of the driver has a semicolon in it. Thus, the ruby code fro the driver was splitting the name of driver, resulting in a keyword syntax error. The following is the (working) code that shows how to connect to csv files using dbi and odbc, note that I had to override require to add the fix to the odbc driver because dbi loads the driver using require:
require "dbi"   

alias :old_require :require 

def require(library)
  old_require(library)
  if library.downcase.include?("odbc")
    define_odbc_fix()
  end
end

def define_odbc_fix
  DBI.class_eval <<-'THERE'
 
  module DBD
    module ODBC
      class Driver < DBI::BaseDriver
        #JPT: fixed to allow the ";" character in the connection string.
        # Obeys the rule of "If a semicolon (;) is part of a value it must be delimited by quotation marks (")"
        # quoted from http://connectionstrings.com/default.aspx?article=what_rules_apply_to_connection_strings
        def connect(dbname, user, auth, attr)
    
        colon_stuffing_string = "@WACKYsUFF@"
          dbname.gsub!('";"', colon_stuffing_string)
          driver_attrs = dbname.split(';')

          if driver_attrs.size > 1
            # DNS-less connection
            drv = ::ODBC::Driver.new
            drv.name = 'Driver1'
            driver_attrs.each do |param|
              param.gsub!(colon_stuffing_string, ";")
              pv = param.split('=')
              next if pv.size < 2
              drv.attrs[pv[0]] = pv[1]
            end
            db = ::ODBC::Database.new
            handle = db.drvconnect(drv)
          else
            # DNS given
            handle = ::ODBC.connect(dbname, user, auth)
          end

          return Database.new(handle, attr)
        rescue ODBCErr => err
          raise DBI::DatabaseError.new(err.message)
        end
      end
    end
  end
  THERE

end

begin
  conn_str = "DBI:ODBC:Driver={Microsoft Text Driver (*.txt\";\" *.csv)};Dbq=$$path_to_folder_with_csvs$$;Extensions=csv;"
  conn_str.gsub!('$$path_to_folder_with_csvs$$', File.expand_path(".\\spreadsheets\\simple"))
  dbh = DBI.connect(conn_str, "", "")
  
  row = dbh.select_one("SELECT * from this_year_trancripts.csv")
  puts row.to_s
rescue DBI::DatabaseError => e
  puts "An error occurred"
  puts "Error code: #{e.err}"
  puts "Error message: #{e.errstr}"
ensure
  # disconnect from server
  dbh.disconnect if dbh
end

Comments

Popular posts from this blog

Power Automate: SFTP action "Test connection failed"

When I added an SFTP create file action to my Power Automate flow ( https://flow.microsoft.com ) , I got the following error in the action step, within the designer: "Test connection failed" To troubleshoot the Power Automate connection, I had to: go the Power Automate portal then "Data"->"Connections"  the sftp connection was there, I clicked on the ellipsis, and entered the connection info It turns out, that screen provides more details about the connection error. In my case, it was complaining that "SSH host key finger-print xxx format is not supported. It must be in 'MD5' format". I had provided the sha fingerprint that WinScp shows. Instead, I needed to use the MD5 version of the fingerprint. To get that, I had to run in command line (I was in a folder that had openssh in it): ssh -o FingerprintHash=md5 mysftpsite.com To get the fingerprint in MD5 format. I took the string (without the "MD5:" part of the string) and put ...

How to create online multiplayer HTML5 games in Contruct2

  Construct2 can use websockets to send and receive messages between games. By using socket-io , we can use a Node.js script as the server and my modification to the socket-io plugin for Construct2 to allow the games to synchronize data between them in real-time. There are two parts to this design: the Node.js server and the Construct2 clients (the games playing). The main part of building an online multiplayer HTML5 game is to plan: how the clients will communicate how often and what to communicate how much of the logic will go into the server and how much to the client. In my sample game, I chose to have each client own a player and have the server just relay messages: Use string messages in the form TypeOfMessage, Parameter1, Paremeter2, Parater3, etc to communicate. Have the clients send their player position about 16 times a second. Whenever their player shoots, the client needs to send a message immediately. Almost all of the game logic will...

How to use Windows SSO with OpenXava

One of the nice things about the .NET web environment is the dead easy way to implement Single Sign On in your web apps through Active Directory authentication. In the Java world there are multiple alternatives to use Windows’ Single Sign On with Java based web apps. One of those alternatives is Waffle . Waffle allows your Java web app to authenticate against Active Directory groups (and users). The only caveat is that your web server needs to be running in Windows, which kind of makes sense. In this article, you will learn the steps required to have your OpenXava web application use Waffle to authenticate your Windows users. The first step is to download Waffle from their site and then copy the JAR files outlined in https://github.com/dblock/waffle/blob/master/Docs/tomcat/TomcatSingleSignOnValve.md to the OpenXava’s tomcat server. In your OpenXava project, create servlets.xml in the Web-inf, containing the following: <!-- the role name (the domain gorup) must be e...